00000001:02000400:2.0F:1789683150.366608:0:2961:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789683163.956830:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789683165.242730:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 991 MB/s 00000001:01000000:2.0:1789683165.493280:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1439 MB/s 00000001:01000000:3.0F:1789683165.742750:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 7927 MB/s 00000020:02000000:2.0:1789683166.231170:0:3271:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_39_g12a437a 00000400:02000000:0.0F:1789683166.954798:0:3286:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.160@tcp [8/256/0/180] 00008000:02000000:2.0:1789683169.855115:0:3435:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:0.0:1789683203.580927:0:5237:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789683210.441874:0:5810:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789683210.441879:0:5810:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789683210.442016:0:5810:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000ff4630a9 00000080:02000400:3.0:1789683210.442025:0:5810:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1789683210.445782:0:5810:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1789683210.445793:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789683210.445825:0:5810:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000feefd6f3) 00000020:00000080:3.0:1789683210.445840:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789683210.457567:0:5810:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789683210.458220:0:5810:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789683210.481252:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789683210.481292:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789683210.481312:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789683210.481360:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789683210.481387:0:5810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789683210.481866:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789683210.481873:0:5810:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789683210.481884:0:5810:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93fe66a 00000020:01000004:2.0:1789683210.481890:0:5810:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789683210.481896:0:5810:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789683210.481900:0:5810:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ff4630a9 from MGS 00000020:01000004:2.0:1789683210.481904:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789683210.481924:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000a7558e3d) 00000020:00000080:2.0:1789683210.481935:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789683210.482042:0:5810:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ff4630a9 from MGS, refs=2 00080000:01000000:2.0:1789683210.482047:0:5810:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789683210.482053:0:5810:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93fe678 00000100:00100000:2.0:1789683210.482145:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789683210.482268:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789683210.482274:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789683210.482842:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789683210.482964:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789683210.483983:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683210.484317:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789683210.484323:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789683210.484961:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789683210.484968:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789683210.485259:0:5810:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789683210.485265:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789683210.485933:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683210.485937:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683210.485938:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683210.486191:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683210.486193:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683210.486194:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683210.486641:0:5810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789683210.488469:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1789683210.736542:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3791 MB/s 00000001:01000000:0.0:1789683210.989190:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4359 MB/s 00000001:01000000:0.0:1789683211.240338:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 681 MB/s 00000001:01000000:2.0:1789683211.490013:0:5810:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 811 MB/s 00080000:10000000:2.0:1789683211.499232:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1789683211.522383:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1789683211.522534:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789683211.522538:0:5810:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789683211.523498:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789683211.523557:0:5810:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789683211.523595:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789683211.524046:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789683211.524072:0:5810:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789683211.524516:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683211.525857:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789683211.525867:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0F:1789683211.527779:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1789683211.527803:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789683211.527979:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789683211.527984:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1789683211.528263:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1789683211.528282:0:5810:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.160@tcp' 00000020:01000004:1.0:1789683211.528284:0:5810:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1789683211.528348:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.160@tcp (typ=mgc) 00000020:00000080:1.0:1789683211.528367:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.160@tcp (00000000f9815399) 00000020:00000080:1.0:1789683211.528384:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1789683211.528552:0:5810:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bdc0ebd7@MGC192.168.203.160@tcp: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1789683211.528774:0:5810:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.160@tcp-0 is initialized 00000040:01000000:1.0:1789683211.528780:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789683211.528979:0:5824:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789683211.530130:0:5825:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789683211.530195:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.160@tcp (uuid 08ddc492-5684-492d-ac6b-b8fd660301db) 00000020:00000080:3.0:1789683211.530221:0:5810:0:(genops.c:1384:class_connect()) connect: client 08ddc492-5684-492d-ac6b-b8fd660301db, cookie 0x59bee33f93fe686 00000100:00080000:3.0:1789683211.530232:0:5810:0:(import.c:545:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683211.530240:0:5810:0:(import.c:666:import_select_connection()) MGC192.168.203.160@tcp: import 00000000bdc0ebd7 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1789683211.530281:0:5810:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000074279f55 x1876618815471744/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683211.530308:0:5810:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 08ddc492-5684-492d-ac6b-b8fd660301db->MGS 00000020:01000004:3.0:1789683211.530330:0:5810:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789683211.530335:0:5810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789683211.530346:0:5810:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000ed9b5ee) 00000020:00000080:3.0:1789683211.530357:0:5810:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789683211.530855:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074279f55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ddc492-5684-492d-ac6b-b8fd660301db:3301:1876618815471744:0@lo:250: 00000100:00100000:2.0:1789683211.530953:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683211.532153:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815471744 00000100:00100000:1.0:1789683211.532162:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815471744 00000100:00100000:1.0:1789683211.532193:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683211.532199:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000af7d05a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3301:x1876618815471744:12345-0@lo:250: 00010000:00080000:1.0:1789683211.532223:0:5822:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 08ddc492-5684-492d-ac6b-b8fd660301db@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:1.0:1789683211.532253:0:5822:0:(genops.c:1384:class_connect()) connect: client 08ddc492-5684-492d-ac6b-b8fd660301db, cookie 0x59bee33f93fe694 00000100:00080000:1.0:1789683211.533180:0:5822:0:(import.c:65:import_set_state_nolock()) 0000000027cf41fe : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683211.533253:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000af7d05a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+5:3301:x1876618815471744:12345-0@lo:250: Request processed in 1052us (2299us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683211.533262:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683211.533753:0:3301:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1789683211.533763:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.160@tcp: connect to target with instance 0 00000100:00080000:2.0:1789683211.533772:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1789683211.533778:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1789683211.533781:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000bdc0ebd7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1789683211.533783:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1789683211.534729:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1789683211.534740:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074279f55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ddc492-5684-492d-ac6b-b8fd660301db:3301:1876618815471744:0@lo:250: 00000100:00100000:0.0:1789683211.549625:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683211.549917:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789683211.549924:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789683211.550512:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789683211.550519:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1789683211.551215:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1789683211.551223:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00010000:00010000:1.0:1789683211.551983:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683211.553441:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683211.553647:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789683211.553654:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789683211.554301:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789683211.554309:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789683211.589500:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683211.589840:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789683211.589855:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789683211.591505:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789683211.591516:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789683211.592169:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683211.592351:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789683211.592357:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789683211.592849:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789683211.592856:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789683211.594427:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683211.595388:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789683211.595395:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789683211.596266:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789683211.596274:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789683211.597583:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683211.597959:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789683211.597966:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789683211.599707:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789683211.599720:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1789683211.623909:0:5810:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683211.624109:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789683211.624115:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789683211.626219:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789683211.626240:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789683211.628466:0:5810:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789683211.628480:0:5810:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789683211.629348:0:5810:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789683211.629367:0:5810:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789683211.629372:0:5810:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789683211.629491:0:5810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789683211.629529:0:5810:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1789683211.629534:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789683211.629535:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683211.629536:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683211.629537:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683211.629538:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683211.629539:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683211.629541:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683211.629542:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683211.629543:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683211.629545:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683211.629546:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683211.629547:0:5810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683211.629549:0:5810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1789683211.629551:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683211.629552:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683211.629554:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683211.629554:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683211.629556:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683211.629557:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683211.629558:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683211.629558:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683211.629559:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683211.629560:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683211.629561:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683211.629561:0:5810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683211.629606:0:5810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789683211.629623:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dac8d3ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815471872:0@lo:253: 00000100:00100000:0.0:1789683211.629723:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683211.629769:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ed40ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683211.629925:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815471872 00000100:00100000:3.0:1789683211.629934:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815471872 00000100:00100000:3.0:1789683211.630159:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683211.630168:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bd44d6c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+5:5810:x1876618815471872:12345-0@lo:253: 20000000:01000000:3.0:1789683211.630931:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789683211.630935:0:5821:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1789683211.632281:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789683211.632357:0:5821:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789683211.632702:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683211.634056:0:5846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1789683211.634247:0:5821:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789683211.634251:0:5821:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1789683211.634257:0:5821:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1789683211.634259:0:5821:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1789683211.634286:0:5821:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1789683211.634472:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683211.634762:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1789683211.634778:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1789683211.634846:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1789683211.634900:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1789683211.634940:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1789683211.635030:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1789683211.635039:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1789683211.635968:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1789683211.635981:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1789683211.636021:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1789683211.636029:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1789683211.636060:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1789683211.636947:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1789683211.637004:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789683211.637010:0:5821:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1789683211.637045:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683211.637249:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1789683211.637260:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789683211.637294:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1789683211.637329:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1789683211.637391:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1789683211.637403:0:5821:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1789683211.637475:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1789683211.637499:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789683211.637545:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1789683211.637581:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1789683211.637614:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1789683211.637633:0:5821:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1789683211.637738:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1789683211.637747:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1789683211.637781:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1789683211.637817:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1789683211.637969:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1789683211.638015:0:5821:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1789683211.638023:0:5821:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789683211.638578:0:5847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1789683211.638818:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1789683211.638838:0:5821:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.160@tcp for mdt 20000000:01000000:3.0:1789683211.638840:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:3.0:1789683211.638870:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1789683211.638876:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1789683211.638902:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1789683211.638908:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:3.0:1789683211.638960:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1789683211.638970:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1789683211.639000:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1789683211.639034:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1789683211.639100:0:5821:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789683211.639104:0:5821:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789683211.639107:0:5821:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789683211.639118:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789683211.639121:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789683211.639148:0:5821:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789683211.639151:0:5821:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789683211.639710:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1789683211.639946:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1789683211.639988:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1789683211.640046:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1789683211.640060:0:5821:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789683211.640062:0:5821:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789683211.640415:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789683211.640641:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789683211.640773:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789683211.640867:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1789683211.640880:0:5821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789683211.640882:0:5821:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1789683211.640887:0:5821:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789683211.640889:0:5821:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1789683211.640894:0:5821:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1789683211.640899:0:5821:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1789683211.641200:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1789683211.641296:0:5821:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1789683211.648425:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1789683211.648576:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1789683211.648663:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1789683211.648996:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789683211.652158:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652182:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652193:0:5821:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652199:0:5821:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652206:0:5821:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652211:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652217:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006e6164e9 already unused, calling callback (000000006ee99501) 00010000:00010000:1.0:1789683211.652220:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652227:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652239:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652257:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.652263:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006e6164e9/0x59bee33f93fe69b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789683211.652281:0:5821:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789683211.808663:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bd44d6c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+5:5810:x1876618815471872:12345-0@lo:253: Request processed in 178490us (178933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683211.808712:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683211.808864:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dac8d3ab pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815471872:0@lo:253: 10000000:01000000:1.0:1789683211.808879:0:5810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789683211.808883:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789683211.808886:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789683211.808887:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683211.808889:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1789683211.808890:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683211.808892:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683211.808893:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789683211.808895:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789683211.808896:0:5810:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1789683211.808897:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683211.808898:0:5810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789683211.808970:0:5810:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ff4630a9 from lustre-MDT0000 10000000:01000000:1.0:1789683211.808995:0:5810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789683211.808998:0:5810:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789683211.809002:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8dbe48a44d40 10000000:01000000:1.0:1789683211.809070:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789683211.809080:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dbe48a44d40 from 1 10000000:01000000:1.0:1789683211.809082:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789683211.809137:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 000000006e6164e9/0x59bee33f93fe6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.809147:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 000000006e6164e9/0x59bee33f93fe6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.809167:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 000000006e6164e9/0x59bee33f93fe6a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683211.809183:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fef5cc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472000:0@lo:101: 00000100:00100000:1.0:1789683211.809222:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683211.809317:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000039bbe0b going to sleep for 11 seconds 00000100:00100000:2.0:1789683211.809335:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815472000 00000100:00100000:2.0:1789683211.809342:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815472000 00000100:00100000:2.0:1789683211.809431:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683211.809439:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f334bc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+5:5810:x1876618815472000:12345-0@lo:101: 00010000:00010000:2.0:1789683211.809452:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683211.809465:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000002882126/0x59bee33f93fe6a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe6a2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683211.809494:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002882126/0x59bee33f93fe6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe6a2 expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683211.809503:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000002882126/0x59bee33f93fe6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe6a2 expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683211.809521:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000002882126, rc 0) 00000100:00100000:2.0:1789683211.809565:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f334bc96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+6:5810:x1876618815472000:12345-0@lo:101: Request processed in 128us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683211.809571:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683211.810912:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fef5cc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472000:0@lo:101: 00010000:00010000:0.0:1789683211.810934:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 000000006e6164e9/0x59bee33f93fe6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683211.810964:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 000000006e6164e9/0x59bee33f93fe6a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683211.811033:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472128:0@lo:501: 00000100:00100000:0.0:1789683211.811079:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683211.811122:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032178c20 going to sleep for 11 seconds 00000100:00100000:3.0:1789683211.811144:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815472128 00000100:00100000:3.0:1789683211.811151:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815472128 00000100:00100000:3.0:1789683211.811194:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683211.811201:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bcca8faa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+6:5810:x1876618815472128:12345-0@lo:501: 00000100:00100000:3.0:1789683211.811413:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bcca8faa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+6:5810:x1876618815472128:12345-0@lo:501: Request processed in 213us (334us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789683211.811421:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683211.811474:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472128:0@lo:501: 10000000:01000000:0.0:1789683211.811505:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789683211.811566:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 000000006e6164e9/0x59bee33f93fe6a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683211.811574:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 000000006e6164e9/0x59bee33f93fe6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683211.811582:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dbe46fc8800 10000000:01000000:0.0:1789683211.811586:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789683211.811590:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dbe46fc8800 10000000:01000000:0.0:1789683211.811593:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789683211.811595:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dbe46fc8800 from 1 10000000:01000000:0.0:1789683211.811599:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789683211.811620:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 00000000553b4733/0x59bee33f93fe6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683211.811626:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 00000000553b4733/0x59bee33f93fe6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683211.811633:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 00000000553b4733/0x59bee33f93fe6b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683211.811654:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472256:0@lo:101: 00000100:00100000:0.0:1789683211.811712:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683211.811729:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032178c20 going to sleep for 11 seconds 00000100:00100000:1.0:1789683211.811843:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815472256 00000100:00100000:1.0:1789683211.811847:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815472256 00000100:00100000:1.0:1789683211.811882:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683211.811888:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000471571a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+6:5810:x1876618815472256:12345-0@lo:101: 00010000:00010000:1.0:1789683211.811897:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683211.811908:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5f713cb/0x59bee33f93fe6b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe6b0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.811924:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5f713cb/0x59bee33f93fe6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe6b0 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.811932:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5f713cb/0x59bee33f93fe6b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe6b0 expref: 7 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683211.811939:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5f713cb, rc 0) 00000100:00100000:1.0:1789683211.811977:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000471571a5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+7:5810:x1876618815472256:12345-0@lo:101: Request processed in 90us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683211.811983:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683211.812047:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472256:0@lo:101: 00010000:00010000:0.0:1789683211.812057:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 00000000553b4733/0x59bee33f93fe6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683211.812064:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 00000000553b4733/0x59bee33f93fe6b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683211.812076:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789683211.812093:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 00000000553b4733/0x59bee33f93fe6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683211.812100:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 00000000553b4733/0x59bee33f93fe6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683211.812106:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789683211.812109:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789683211.812114:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dbe46fc8800 10000000:01000000:0.0:1789683211.812116:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789683211.812119:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789683211.812121:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789683211.812137:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 0000000091e6c592/0x59bee33f93fe6be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683211.812143:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 0000000091e6c592/0x59bee33f93fe6be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683211.812159:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 0000000091e6c592/0x59bee33f93fe6be lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683211.812170:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472384:0@lo:101: 00000100:00100000:0.0:1789683211.812194:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683211.812215:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032178c20 going to sleep for 11 seconds 00000100:00100000:3.0:1789683211.812563:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815472384 00000100:00100000:3.0:1789683211.812569:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815472384 00000100:00100000:3.0:1789683211.812639:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683211.812647:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b2337ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+7:5810:x1876618815472384:12345-0@lo:101: 00010000:00010000:3.0:1789683211.812655:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683211.812664:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000a28c2ad/0x59bee33f93fe6c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe6be expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683211.812709:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000a28c2ad/0x59bee33f93fe6c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe6be expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683211.812718:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000a28c2ad/0x59bee33f93fe6c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe6be expref: 8 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683211.812724:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000a28c2ad, rc 0) 00000100:00100000:3.0:1789683211.812758:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b2337ef2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+8:5810:x1876618815472384:12345-0@lo:101: Request processed in 113us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683211.812764:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683211.812825:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472384:0@lo:101: 00010000:00010000:0.0:1789683211.812836:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 0000000091e6c592/0x59bee33f93fe6be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683211.812843:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 0000000091e6c592/0x59bee33f93fe6be lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683211.812882:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472512:0@lo:501: 00000100:00100000:0.0:1789683211.812904:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683211.813014:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032178c20 going to sleep for 11 seconds 00000100:00100000:1.0:1789683211.813075:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815472512 00000100:00100000:1.0:1789683211.813080:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815472512 00000100:00100000:1.0:1789683211.813098:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683211.813104:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051fd4056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+8:5810:x1876618815472512:12345-0@lo:501: 00000100:00100000:1.0:1789683211.813345:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051fd4056 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+9:5810:x1876618815472512:12345-0@lo:501: Request processed in 240us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683211.813353:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683211.813559:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472512:0@lo:501: 00000100:00100000:0.0:1789683211.813585:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472640:0@lo:503: 00000100:00100000:0.0:1789683211.813620:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683211.813694:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032178c20 going to sleep for 11 seconds 00000100:00100000:3.0:1789683211.813750:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815472640 00000100:00100000:3.0:1789683211.813755:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815472640 00000100:00100000:1.0:1789683211.813826:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683211.813834:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000022d9d74a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+9:5810:x1876618815472640:12345-0@lo:503: 00000100:00100000:1.0:1789683211.814017:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000022d9d74a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+9:5810:x1876618815472640:12345-0@lo:503: Request processed in 185us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683211.814024:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683211.814082:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815472640:0@lo:503: 00000100:00100000:1.0:1789683211.814424:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0e2cabe pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:5852:1876618815472768:0@lo:502: 00000100:00100000:1.0:1789683211.814538:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683211.814599:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d6ce977a going to sleep for 11 seconds 00000100:00100000:3.0:1789683211.814634:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815472768 00000100:00100000:3.0:1789683211.814639:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815472768 00000100:00100000:3.0:1789683211.814756:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683211.814762:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000cfd3e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+9:5852:x1876618815472768:12345-0@lo:502: 00000100:00100000:3.0:1789683211.814955:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000cfd3e6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+9:5852:x1876618815472768:12345-0@lo:502: Request processed in 193us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683211.814962:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683211.815042:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0e2cabe pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:5852:1876618815472768:0@lo:502: 00000020:01000000:1.0:1789683211.815064:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683211.815075:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683211.815077:0:5852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789683211.815083:0:5852:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789683211.815085:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683211.815099:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000009d63293) 00000020:00000080:1.0:1789683211.815116:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789683211.815121:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789683211.815183:0:5852:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789683211.815189:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93fe6d3 00000020:00000080:1.0:1789683211.815420:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789683211.815424:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683211.815428:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683211.815429:0:5852:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789683211.815432:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683211.815435:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683211.815523:0:5852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789683211.815529:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683211.815536:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f9064ca6) 00000020:00000080:1.0:1789683211.815546:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789683211.815549:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789683211.815550:0:5852:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789683211.815553:0:5852:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789683211.815558:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789683211.815608:0:5852:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ff4630a9 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789683211.815621:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000053023ccb) 00000020:00000080:1.0:1789683211.815628:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789683211.815696:0:5852:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789683211.815701:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93fe6e8 00000020:00000080:1.0:1789683211.815783:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789683211.815790:0:5852:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789683211.815793:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x59bee33f93fe6ef 00080000:01000000:1.0:1789683211.815797:0:5852:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789683211.815800:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93fe6f6 00080000:10000000:1.0:1789683211.816149:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1789683211.816360:0:5852:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1789683211.819831:0:5852:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789683211.873217:0:5852:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789683211.873848:0:5852:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789683211.876347:0:5852:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789683211.876772:0:5852:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789683211.896193:0:5852:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000068791f58) 00000020:00000080:1.0:1789683211.896216:0:5852:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789683211.896290:0:5852:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789683211.896298:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93fe704 00000020:00000080:0.0:1789683211.896786:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1789683211.898000:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789683211.936267:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789683211.967894:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789683212.002042:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789683212.048776:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789683212.076407:0:5852:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1789683212.117847:0:5852:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x59bee33f93fe70b 00000020:00000080:0.0:1789683212.118612:0:5852:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1789683212.118628:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683212.118635:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683212.118638:0:5852:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1789683212.118642:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683212.118647:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683212.118648:0:5852:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789683212.118652:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789683212.118653:0:5852:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789683212.118656:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683212.118659:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683212.118660:0:5852:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789683212.118662:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683212.118667:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683212.118668:0:5852:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1789683212.118702:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1789683212.118748:0:5852:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1789683212.118819:0:5852:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:5852:1876618815472896:0@lo:502: 00000100:00100000:0.0:1789683212.119246:0:5852:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683212.119367:0:5852:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036b756ca going to sleep for 11 seconds 00000100:00100000:2.0:1789683212.119644:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815472896 00000100:00100000:2.0:1789683212.119654:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815472896 00000100:00100000:2.0:1789683212.119767:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683212.119778:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eb573a60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+9:5852:x1876618815472896:12345-0@lo:502: 00000100:00100000:2.0:1789683212.120230:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eb573a60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+9:5852:x1876618815472896:12345-0@lo:502: Request processed in 453us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683212.120238:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683212.120339:0:5852:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007551a459 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:5852:1876618815472896:0@lo:502: 00000020:01000000:3.0:1789683212.120376:0:5852:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683212.120383:0:5852:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683212.120385:0:5852:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1789683212.120390:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1789683212.120812:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1789683212.120849:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789683212.120870:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 0000000091e6c592/0x59bee33f93fe6be lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.120884:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 0000000091e6c592/0x59bee33f93fe6be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683212.120904:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dbe46fc8800 from 1 10000000:01000000:0.0:1789683212.120907:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789683212.120945:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.120952:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.120962:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683212.120982:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473024:0@lo:101: 00000100:00100000:0.0:1789683212.121024:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683212.121272:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff52830d going to sleep for 11 seconds 00000100:00100000:1.0:1789683212.121385:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815473024 00000100:00100000:1.0:1789683212.121393:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815473024 00000100:00100000:1.0:1789683212.121427:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683212.121446:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f0790bec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+9:5810:x1876618815473024:12345-0@lo:101: 00010000:00010000:1.0:1789683212.121467:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683212.121491:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe712 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683212.121517:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe712 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683212.121528:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe712 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683212.121538:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ba1fa3ae, rc 0) 00000100:00100000:1.0:1789683212.121581:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f0790bec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+10:5810:x1876618815473024:12345-0@lo:101: Request processed in 147us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683212.121588:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683212.121721:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473024:0@lo:101: 00010000:00010000:0.0:1789683212.121737:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.121746:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683212.122414:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473152:0@lo:256: 00000100:00100000:0.0:1789683212.122541:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683212.122579:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff52830d going to sleep for 11 seconds 00000100:00100000:2.0:1789683212.122653:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815473152 00000100:00100000:2.0:1789683212.122659:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815473152 00000100:00100000:2.0:1789683212.122720:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683212.122727:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000016137fde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+10:5810:x1876618815473152:12345-0@lo:256: 20000000:01000000:2.0:1789683212.122746:0:5823:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789683212.122753:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789683212.122821:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000016137fde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+10:5810:x1876618815473152:12345-0@lo:256: Request processed in 94us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683212.122828:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683212.122918:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473152:0@lo:256: 10000000:01000000:0.0:1789683212.123756:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789683212.123774:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.123796:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683212.123807:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe46fc8800 from 1 10000000:01000000:0.0:1789683212.123810:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683212.123847:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.123854:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.123865:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683212.123881:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473280:0@lo:101: 00000100:00100000:0.0:1789683212.123923:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683212.123952:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff52830d going to sleep for 11 seconds 00000100:00100000:1.0:1789683212.124035:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815473280 00000100:00100000:1.0:1789683212.124043:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815473280 00000100:00100000:1.0:1789683212.124072:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683212.124079:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000192f9d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+10:5810:x1876618815473280:12345-0@lo:101: 00010000:00010000:1.0:1789683212.124089:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683212.124103:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe720 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683212.124122:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe720 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683212.124132:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe720 expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683212.124139:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007b7e148e, rc 0) 00000100:00100000:1.0:1789683212.124180:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000192f9d7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:5810:x1876618815473280:12345-0@lo:101: Request processed in 101us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683212.124186:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683212.124364:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473280:0@lo:101: 00010000:00010000:0.0:1789683212.124377:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.124386:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683212.124435:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473408:0@lo:501: 00000100:00100000:0.0:1789683212.124529:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683212.124577:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff52830d going to sleep for 11 seconds 00000100:00100000:3.0:1789683212.124637:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815473408 00000100:00100000:3.0:1789683212.124642:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815473408 00000100:00100000:1.0:1789683212.124693:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789683212.124699:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000be42b1e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:5810:x1876618815473408:12345-0@lo:501: 00000100:00100000:1.0:1789683212.125588:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000be42b1e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:5810:x1876618815473408:12345-0@lo:501: Request processed in 887us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683212.125598:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683212.125721:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473408:0@lo:501: 00000100:00100000:0.0:1789683212.125770:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473536:0@lo:503: 00000100:00100000:0.0:1789683212.125811:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683212.125975:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ff52830d going to sleep for 11 seconds 00000100:00100000:2.0:1789683212.126009:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815473536 00000100:00100000:2.0:1789683212.126015:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815473536 00000100:00100000:2.0:1789683212.126042:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683212.126047:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000853afd0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:5810:x1876618815473536:12345-0@lo:503: 00000040:00080000:2.0:1789683212.126089:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683212.126129:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000853afd0c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:5810:x1876618815473536:12345-0@lo:503: Request processed in 81us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683212.126140:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683212.126269:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473536:0@lo:503: 00000040:00080000:0.0:1789683212.127577:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789683212.128018:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789683212.128040:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683212.128093:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683212.128109:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683212.128162:0:5810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683212.128165:0:5810:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dbe46fc8800 10000000:01000000:2.0:1789683212.128168:0:5810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dbe46fc8800 10000000:01000000:2.0:1789683212.128173:0:5810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683212.128180:0:5810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe46fc8800 from 1 10000000:01000000:2.0:1789683212.128182:0:5810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683212.128315:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 0000000005975980/0x59bee33f93fe72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683212.128325:0:5810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 0000000005975980/0x59bee33f93fe72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683212.128335:0:5810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 0000000005975980/0x59bee33f93fe72e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683212.128358:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d755fdba pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473664:0@lo:101: 00000100:00100000:2.0:1789683212.128429:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683212.128559:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edf54635 going to sleep for 11 seconds 00000100:00100000:0.0:1789683212.128626:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815473664 00000100:00100000:0.0:1789683212.128635:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815473664 00000100:00100000:0.0:1789683212.128804:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683212.128814:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009f74e16b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:5810:x1876618815473664:12345-0@lo:101: 00010000:00010000:0.0:1789683212.128831:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683212.128846:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003f989050/0x59bee33f93fe735 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe72e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.128872:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003f989050/0x59bee33f93fe735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe72e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.128884:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003f989050/0x59bee33f93fe735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe72e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.128893:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003f989050, rc 0) 00000100:00100000:0.0:1789683212.128932:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009f74e16b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:5810:x1876618815473664:12345-0@lo:101: Request processed in 120us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683212.128939:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789683212.129016:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d755fdba pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473664:0@lo:101: 00010000:00010000:2.0:1789683212.129032:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 0000000005975980/0x59bee33f93fe72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683212.129050:0:5810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 0000000005975980/0x59bee33f93fe72e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683212.129105:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d755fdba pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473792:0@lo:501: 00000100:00100000:2.0:1789683212.129132:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683212.129386:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edf54635 going to sleep for 11 seconds 00000100:00100000:1.0:1789683212.129527:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815473792 00000100:00100000:1.0:1789683212.129533:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815473792 00000100:00100000:1.0:1789683212.129559:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683212.129565:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f8d1f3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:5810:x1876618815473792:12345-0@lo:501: 00000100:00100000:1.0:1789683212.129985:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f8d1f3f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:5810:x1876618815473792:12345-0@lo:501: Request processed in 419us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683212.129994:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789683212.130092:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d755fdba pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473792:0@lo:501: 00000100:00100000:2.0:1789683212.130128:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000d755fdba pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473920:0@lo:503: 00000100:00100000:2.0:1789683212.130170:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683212.130295:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 00000000edf54635 going to sleep for 11 seconds 00000100:00100000:3.0:1789683212.130333:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815473920 00000100:00100000:3.0:1789683212.130339:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815473920 00000100:00100000:1.0:1789683212.130384:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683212.130392:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000bb857b78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:5810:x1876618815473920:12345-0@lo:503: 00000100:00100000:1.0:1789683212.130844:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000bb857b78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:5810:x1876618815473920:12345-0@lo:503: Request processed in 452us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683212.130852:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789683212.131001:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000d755fdba pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815473920:0@lo:503: 00000100:00100000:1.0:1789683212.131513:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a0e2cabe pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:5857:1876618815474048:0@lo:502: 00000100:00100000:1.0:1789683212.131559:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683212.131624:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 000000006098f62a going to sleep for 11 seconds 00000100:00100000:3.0:1789683212.131715:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815474048 00000100:00100000:3.0:1789683212.131722:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815474048 00000100:00100000:3.0:1789683212.131747:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683212.131754:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f2fdd4d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:5857:x1876618815474048:12345-0@lo:502: 00000100:00100000:3.0:1789683212.131994:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f2fdd4d2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:5857:x1876618815474048:12345-0@lo:502: Request processed in 240us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683212.132002:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683212.132047:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a0e2cabe pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:5857:1876618815474048:0@lo:502: 00000020:01000004:3.0:1789683212.132116:0:5857:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789683212.132134:0:5857:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000006c12c789) 00000020:00000080:3.0:1789683212.132161:0:5857:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789683212.132414:0:5857:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ff4630a9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789683212.132418:0:5857:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000ff4630a9 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789683212.132421:0:5857:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000ff4630a9 4 00010000:00080000:3.0:1789683212.132531:0:5857:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000884abf8c@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1789683212.135373:0:5857:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1789683212.135778:0:5857:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789683212.135825:0:5857:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683212.135843:0:5857:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x59bee33f93fe743 00000100:00080000:3.0:1789683212.135856:0:5857:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683212.135870:0:5857:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000884abf8c using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1789683212.135916:0:5857:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000532d74be x1876618815474176/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683212.135937:0:5857:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789683212.136054:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000532d74be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815474176:0@lo:38: 00000100:00100000:2.0:1789683212.136154:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683212.136309:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815474176 00000100:00100000:2.0:1789683212.136318:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815474176 00000100:00100000:2.0:1789683212.136356:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683212.136363:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d755fdba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876618815474176:12345-0@lo:38: 00000100:00100000:2.0:1789683212.136419:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d755fdba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876618815474176:12345-0@lo:38: Request processed in 56us (266us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789683212.136426:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683212.136552:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683212.136561:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000884abf8c lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683212.136566:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789683212.136569:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000532d74be pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815474176:0@lo:38: 00000100:00100000:1.0:1789683212.137130:0:5857:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000832d13d6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:5857:1876618815474304:0@lo:502: 00000100:00100000:1.0:1789683212.137193:0:5857:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683212.137297:0:5857:0:(client.c:2716:ptlrpc_set_wait()) set 000000006098f62a going to sleep for 11 seconds 00000100:00100000:2.0:1789683212.137353:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815474304 00000100:00100000:2.0:1789683212.137360:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815474304 00000100:00100000:2.0:1789683212.137402:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789683212.137409:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000febf61df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:5857:x1876618815474304:12345-0@lo:502: 00000100:00100000:2.0:1789683212.137912:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000febf61df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:5857:x1876618815474304:12345-0@lo:502: Request processed in 503us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683212.137922:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683212.140845:0:5857:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000832d13d6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:5857:1876618815474304:0@lo:502: 00000040:00080000:1.0:1789683212.140927:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789683212.141132:0:5810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789683212.141157:0:5810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789683212.141182:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 0000000005975980/0x59bee33f93fe72e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.141306:0:5810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 0000000005975980/0x59bee33f93fe72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789683212.141356:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789683212.141359:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683212.141360:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683212.141362:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683212.141363:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683212.141364:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683212.141365:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683212.141367:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683212.141368:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683212.141370:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683212.141371:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683212.141373:0:5810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683212.141377:0:5810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789683212.141380:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683212.141381:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683212.141382:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683212.141382:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683212.141383:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683212.141384:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683212.141385:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683212.141386:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683212.141387:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683212.141388:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683212.141388:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683212.141389:0:5810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683212.141418:0:5810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789683212.141514:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815474432:0@lo:253: 00000100:00100000:0.0:1789683212.141597:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683212.141697:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e5cdc47 going to sleep for 11 seconds 00000100:00100000:1.0:1789683212.142032:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815474432 00000100:00100000:1.0:1789683212.142041:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815474432 00000100:00100000:2.0:1789683212.142114:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789683212.142124:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014e33101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:5810:x1876618815474432:12345-0@lo:253: 20000000:01000000:2.0:1789683212.142159:0:5823:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789683212.142176:0:5823:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789683212.181801:0:5823:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789683212.181852:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789683212.182585:0:5845:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789683212.182593:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789683212.182618:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.182653:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe712 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.182662:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.182738:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe712 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.182777:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe712 expref: 12 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683212.182795:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097b7e536 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1876618815474560:0@lo:104: 00000100:00100000:3.0:1789683212.182898:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683212.183017:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053a8cc1c going to sleep for 11 seconds 00000100:00100000:1.0:1789683212.184152:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815474560 00000100:00100000:1.0:1789683212.184164:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815474560 00000100:00100000:1.0:1789683212.184227:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683212.184237:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000014604f86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+3:5845:x1876618815474560:12345-0@lo:104: 00010000:00010000:1.0:1789683212.184253:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683212.184342:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683212.184348:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014604f86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+3:5845:x1876618815474560:12345-0@lo:104: Request processed in 113us (1451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683212.184355:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789683212.184420:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683212.184426:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.184435:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000062aaf1fa already unused, calling callback (000000007d5fc210) 10000000:00010000:3.0:1789683212.184448:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.184457:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683212.184465:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683212.184471:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683212.184522:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.184530:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683212.184549:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.184556:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: 0000000062aaf1fa/0x59bee33f93fe712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe719 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.184591:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683212.184592:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683212.184594:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683212.184866:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093003dc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815474688:0@lo:103: 00000100:00100000:3.0:1789683212.184910:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683212.185010:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815474688 00000100:00100000:3.0:1789683212.185016:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815474688 00010000:00010000:3.0:1789683212.185036:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe712 expref: 13 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683212.185062:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789683212.185068:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000003277b444 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+13:3303:x1876618815474688:12345-0@lo:103: 00010000:00010000:3.0:1789683212.185080:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683212.185085:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe712 expref: 13 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185095:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe712 expref: 13 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185114:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185122:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789683212.185141:0:5814:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002548946s 00010000:00010000:3.0:1789683212.185146:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185165:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185171:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185178:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185183:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ba25a078 already unused, calling callback (000000006ee99501) 00010000:00010000:3.0:1789683212.185187:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185195:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185203:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683212.185215:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683212.185245:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000003277b444 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+13:3303:x1876618815474688:12345-0@lo:103: Request processed in 178us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683212.185252:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789683212.185294:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093003dc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815474688:0@lo:103: 00010000:00010000:0.0:1789683212.185964:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ba1fa3ae/0x59bee33f93fe719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe712 expref: 12 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683212.185989:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097b7e536 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1876618815474560:0@lo:104: 00010000:00010000:0.0:1789683212.186006:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.186015:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.186021:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683212.186027:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ba25a078/0x59bee33f93fe74a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683212.192630:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000014e33101 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:5810:x1876618815474432:12345-0@lo:253: Request processed in 50496us (51022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683212.192659:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683212.192975:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000003c71bc8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:5810:1876618815474432:0@lo:253: 10000000:01000000:0.0:1789683212.192995:0:5810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789683212.192999:0:5810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683212.193001:0:5810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683212.193002:0:5810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683212.193004:0:5810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683212.193005:0:5810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683212.193007:0:5810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683212.193008:0:5810:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683212.193010:0:5810:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683212.193011:0:5810:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683212.193013:0:5810:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683212.193015:0:5810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683212.193016:0:5810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789683212.193035:0:5810:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789683212.200032:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789683212.200919:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789683212.201165:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789683212.201354:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789683212.201783:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789683212.201997:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789683212.203612:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789683212.203918:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789683212.204134:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789683212.204312:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789683212.204630:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789683212.204904:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1789683212.246344:0:5810:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789683212.285059:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1789683212.285551:0:5862:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789683212.285556:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1789683212.285784:0:5863:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789683212.290798:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789683212.291715:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1789683212.292189:0:5810:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789683212.292202:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789683212.292765:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683212.294818:0:5810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789683212.295658:0:5810:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789683212.295736:0:5810:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789683212.296092:0:5810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789683212.296431:0:5810:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789683212.298132:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789683212.298414:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789683212.298764:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789683212.299052:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789683212.299394:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789683212.299596:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789683212.299817:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789683212.299965:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789683212.300133:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789683212.300283:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789683212.300567:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789683212.300835:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789683212.301055:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789683212.301241:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789683212.301512:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789683212.301749:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789683212.302096:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789683212.302268:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789683212.302551:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789683212.302771:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1789683212.302971:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1789683212.303167:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1789683212.303531:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1789683212.303824:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:0.0:1789683212.304125:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:0.0:1789683212.304414:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:0.0:1789683212.304755:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:0.0:1789683212.304995:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:0.0:1789683212.305181:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:0.0:1789683212.305450:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:0.0:1789683212.305726:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:0.0:1789683212.305907:0:5810:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:0.0:1789683212.306176:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1789683212.316812:0:5863:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1789683212.383995:0:5810:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789683212.384044:0:5810:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9e3e41d67988 00100000:10000000:3.0:1789683212.384054:0:5810:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789683212.386238:0:5810:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789683212.386260:0:5810:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789683212.386274:0:5810:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1789683212.386298:0:5810:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1789683212.419619:0:5863:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789683212.419700:0:5863:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789683212.419713:0:5863:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1789683212.576322:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683213.600196:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683214.625398:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789683215.400230:0:6106:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789683215.647905:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683216.671875:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683217.376163:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789683217.376177:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683217.376180:0:38:0:(import.c:65:import_set_state_nolock()) 00000000884abf8c lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683217.376203:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000884abf8c using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1789683217.376228:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000155fa45d x1876618815474944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683217.376446:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000093003dc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815474816:0@lo:400: 00000100:00100000:1.0:1789683217.376541:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683217.376701:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815474816 00000100:00100000:3.0:1789683217.376713:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815474816 00000100:00100000:3.0:1789683217.377143:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789683217.377155:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006f5c2694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:3304:x1876618815474816:12345-0@lo:400: 00000100:00100000:3.0:1789683217.377242:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006f5c2694 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:3304:x1876618815474816:12345-0@lo:400: Request processed in 90us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683217.377248:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789683217.377346:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000155fa45d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815474944:0@lo:38: 00000100:00100000:2.0:1789683217.377388:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683217.377462:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815474944 00000100:00100000:0.0:1789683217.377477:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815474944 00000100:00100000:0.0:1789683217.377522:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683217.377528:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000011317753 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876618815474944:12345-0@lo:38: 00010000:00080000:0.0:1789683217.377558:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000100:00100000:2.0:1789683217.377692:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000093003dc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815474816:0@lo:400: 00000020:00000080:0.0:1789683217.377853:0:5831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x59bee33f93fe751 00000004:00100000:0.0:1789683217.377922:0:5831:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789683217.378196:0:5831:0:(import.c:65:import_set_state_nolock()) 0000000085dfd208 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683217.378289:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000011317753 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876618815474944:12345-0@lo:38: Request processed in 760us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683217.378296:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789683217.378665:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000155fa45d x1876618815474944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683227 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683217.378710:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789683217.378736:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789683217.378742:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789683217.378745:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000884abf8c lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789683217.378752:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000155fa45d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815474944:0@lo:38: 00010000:00010000:0.0:1789683217.696178:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683218.720856:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789683219.073930:0:6307:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef10951c0 20000000:00000080:3.0:1789683219.073946:0:6307:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dbe75e41c00 uarg=0000000000000000 20000000:01000000:3.0:1789683219.074010:0:6307:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1789683219.074017:0:6307:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1789683219.074022:0:6307:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789683219.074211:0:6307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1789683219.074221:0:6307:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1789683219.079276:0:6307:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683219.079626:0:6307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789683219.079835:0:6307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1789683219.079894:0:6307:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1789683219.079912:0:6307:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789683219.079937:0:6307:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683219.079956:0:6307:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe720 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683219.079964:0:6307:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683219.080003:0:6307:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe720 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683219.080018:0:6307:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe720 expref: 10 pid: 5822 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683219.080030:0:6307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000740de4ed pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6307:1876618815475072:0@lo:104: 00000100:00100000:3.0:1789683219.080092:0:6307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683219.080147:0:6307:0:(client.c:2716:ptlrpc_set_wait()) set 0000000035f1c22b going to sleep for 11 seconds 00000100:00100000:1.0:1789683219.080420:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815475072 00000100:00100000:1.0:1789683219.080437:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815475072 00000100:00100000:1.0:1789683219.080489:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683219.080497:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000119b2d7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:6307:x1876618815475072:12345-0@lo:104: 00010000:00010000:1.0:1789683219.080509:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683219.080570:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683219.080576:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000119b2d7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:6307:x1876618815475072:12345-0@lo:104: Request processed in 81us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683219.080589:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683219.080665:0:6307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000740de4ed pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6307:1876618815475072:0@lo:104: 00010000:00010000:3.0:1789683219.080724:0:6307:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.080913:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683219.080919:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.080926:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007d2fb2a0 already unused, calling callback (000000007d5fc210) 10000000:00010000:2.0:1789683219.080929:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.080937:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683219.080943:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683219.080948:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683219.081018:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081025:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683219.081053:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081059:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: 000000007d2fb2a0/0x59bee33f93fe720 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081076:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683219.081084:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683219.081086:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683219.081121:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683219.081132:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ce5be57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815475200:0@lo:103: 00000100:00100000:3.0:1789683219.081165:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683219.081239:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815475200 00000100:00100000:2.0:1789683219.081245:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815475200 00010000:00010000:2.0:1789683219.081263:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe720 expref: 11 pid: 5822 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683219.081293:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683219.081300:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000740de4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+11:3304:x1876618815475200:12345-0@lo:103: 00010000:00010000:2.0:1789683219.081309:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683219.081314:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe720 expref: 11 pid: 5822 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081324:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe720 expref: 11 pid: 5822 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081337:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007b7e148e/0x59bee33f93fe727 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe720 expref: 11 pid: 5822 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081350:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081358:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081373:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081379:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081385:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081397:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081403:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000076e2de34 already unused, calling callback (000000006ee99501) 00010000:00010000:2.0:1789683219.081405:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081413:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081423:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.081443:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683219.081475:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000740de4ed pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+10:3304:x1876618815475200:12345-0@lo:103: Request processed in 176us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683219.081482:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683219.081509:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ce5be57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815475200:0@lo:103: 00010000:00010000:3.0:1789683219.081570:0:6307:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683219.081579:0:6307:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683219.081595:0:6307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000076e2de34/0x59bee33f93fe758 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6307 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683219.507813:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789683219.507821:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dbe46fc8800 from 3 10000000:01000000:1.0:1789683219.507827:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789683219.507868:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 0000000089206613/0x59bee33f93fe75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683219.507880:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 0000000089206613/0x59bee33f93fe75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683219.507890:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 0000000089206613/0x59bee33f93fe75f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683219.507922:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000832d13d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475328:0@lo:101: 00000100:00100000:1.0:1789683219.507983:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683219.508040:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 0000000032c1022c going to sleep for 11 seconds 00000100:00100000:2.0:1789683219.509125:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815475328 00000100:00100000:2.0:1789683219.509136:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815475328 00000100:00100000:2.0:1789683219.509650:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683219.509660:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a55f0fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+10:5825:x1876618815475328:12345-0@lo:101: 00010000:00010000:2.0:1789683219.509711:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683219.509730:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e13bbfb9/0x59bee33f93fe766 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe75f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.509756:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e13bbfb9/0x59bee33f93fe766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe75f expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.509784:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e13bbfb9/0x59bee33f93fe766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe75f expref: 11 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.509792:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e13bbfb9, rc 0) 00000100:00100000:2.0:1789683219.509856:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a55f0fd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:5825:x1876618815475328:12345-0@lo:101: Request processed in 197us (1872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683219.509862:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683219.509955:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000832d13d6 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475328:0@lo:101: 00010000:00010000:3.0:1789683219.509973:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 0000000089206613/0x59bee33f93fe75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683219.509982:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 0000000089206613/0x59bee33f93fe75f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683219.510040:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b4c3919c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475456:0@lo:256: 00000100:00100000:3.0:1789683219.510075:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683219.522169:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815475456 00000100:00100000:1.0:1789683219.522187:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815475456 00000100:00100000:2.0:1789683219.523444:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b869462d going to sleep for 11 seconds 00000100:00100000:0.0:1789683219.523522:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683219.523535:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f937e8fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:5825:x1876618815475456:12345-0@lo:256: 20000000:01000000:0.0:1789683219.523558:0:5822:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683219.523579:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683219.523581:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789683219.523717:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f937e8fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:5825:x1876618815475456:12345-0@lo:256: Request processed in 185us (13642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683219.523724:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789683219.529165:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b4c3919c pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475456:0@lo:256: 10000000:01000000:2.0:1789683219.531220:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683219.531235:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: 0000000089206613/0x59bee33f93fe75f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.531249:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: 0000000089206613/0x59bee33f93fe75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683219.531260:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683219.531263:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe46fc8800 from 1 10000000:01000000:2.0:1789683219.531267:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683219.531307:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: 00000000875fe17a/0x59bee33f93fe76d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.531315:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: 00000000875fe17a/0x59bee33f93fe76d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683219.531325:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: 00000000875fe17a/0x59bee33f93fe76d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683219.531349:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003ce5be57 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475584:0@lo:101: 00000100:00100000:2.0:1789683219.531421:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683219.531483:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e8377e32 going to sleep for 11 seconds 00000100:00100000:0.0:1789683219.535899:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815475584 00000100:00100000:0.0:1789683219.535917:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815475584 00000100:00100000:0.0:1789683219.535976:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683219.535986:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b7bb47ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:5825:x1876618815475584:12345-0@lo:101: 00010000:00010000:0.0:1789683219.536830:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683219.536852:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007d2fb2a0/0x59bee33f93fe774 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe76d expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683219.536882:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007d2fb2a0/0x59bee33f93fe774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe76d expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683219.536894:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007d2fb2a0/0x59bee33f93fe774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe76d expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683219.536902:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007d2fb2a0, rc 0) 00000100:00100000:0.0:1789683219.536981:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b7bb47ac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:5825:x1876618815475584:12345-0@lo:101: Request processed in 997us (5560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683219.536988:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789683219.537770:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003ce5be57 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475584:0@lo:101: 00010000:00010000:1.0:1789683219.537792:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: 00000000875fe17a/0x59bee33f93fe76d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683219.537804:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: 00000000875fe17a/0x59bee33f93fe76d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683219.537875:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d5972ca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475712:0@lo:501: 00000100:00100000:1.0:1789683219.537920:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683219.537965:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9b80aa4 going to sleep for 11 seconds 00000100:00100000:0.0:1789683219.538297:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815475712 00000100:00100000:0.0:1789683219.538305:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815475712 00000100:00100000:0.0:1789683219.538339:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683219.538822:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a3db68c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:5825:x1876618815475712:12345-0@lo:501: 00000100:00100000:0.0:1789683219.539644:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a3db68c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:5825:x1876618815475712:12345-0@lo:501: Request processed in 568us (1465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683219.539655:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789683219.540104:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d5972ca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475712:0@lo:501: 00000100:00100000:1.0:1789683219.541086:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006d5972ca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475840:0@lo:503: 00000100:00100000:1.0:1789683219.541461:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683219.541509:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b9b80aa4 going to sleep for 11 seconds 00000100:00100000:2.0:1789683219.541724:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815475840 00000100:00100000:2.0:1789683219.541733:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815475840 00000100:00100000:2.0:1789683219.541773:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683219.541781:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b1af5d53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:5825:x1876618815475840:12345-0@lo:503: 00000100:00100000:2.0:1789683219.541994:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b1af5d53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:5825:x1876618815475840:12345-0@lo:503: Request processed in 214us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683219.542003:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683219.542056:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006d5972ca pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815475840:0@lo:503: 00000100:00100000:1.0:1789683219.543771:0:6323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe25dc84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6323:1876618815475968:0@lo:502: 00000100:00100000:1.0:1789683219.543842:0:6323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683219.543892:0:6323:0:(client.c:2716:ptlrpc_set_wait()) set 00000000bbf2ef9d going to sleep for 11 seconds 00000100:00100000:3.0:1789683219.549085:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815475968 00000100:00100000:3.0:1789683219.549101:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815475968 00000100:00100000:3.0:1789683219.549203:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683219.549213:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a0777ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:6323:x1876618815475968:12345-0@lo:502: 00000100:00100000:3.0:1789683219.549465:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a0777ed4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:6323:x1876618815475968:12345-0@lo:502: Request processed in 254us (5623us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683219.549473:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683219.549704:0:6323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe25dc84 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6323:1876618815475968:0@lo:502: 00000020:01000000:1.0:1789683219.549750:0:6323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683219.549759:0:6323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683219.549761:0:6323:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789683219.549770:0:6323:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe46fc8800 00000020:00000080:1.0:1789683219.549773:0:6323:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789683219.549835:0:6323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6323:1876618815476096:0@lo:502: 00000100:00100000:1.0:1789683219.549881:0:6323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683219.549924:0:6323:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683219.550108:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815476096 00000100:00100000:0.0:1789683219.550114:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815476096 00000100:00100000:0.0:1789683219.550171:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683219.550180:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:6323:x1876618815476096:12345-0@lo:502: 00000100:00100000:0.0:1789683219.550306:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:6323:x1876618815476096:12345-0@lo:502: Request processed in 126us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683219.550314:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789683219.550850:0:6323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6323:1876618815476096:0@lo:502: 00000020:01000000:1.0:1789683219.550873:0:6323:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683219.550879:0:6323:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683219.550880:0:6323:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789683219.550885:0:6323:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1789683219.551243:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789683219.551262:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683219.551272:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683219.551283:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683219.746022:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683220.769143:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683221.792646:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683222.497775:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815476352:0@lo:400: 00000100:00100000:2.0:1789683222.497850:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683222.497904:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683222.497911:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815476224:0@lo:400: 00000100:00100000:2.0:1789683222.497939:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683222.497972:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815476352 00000100:00100000:2.0:1789683222.497980:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815476352 00000100:00100000:2.0:1789683222.498022:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683222.498031:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815476352:12345-0@lo:400: 00000100:00100000:2.0:1789683222.498081:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815476352:12345-0@lo:400: Request processed in 52us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683222.498089:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789683222.498128:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dbe7bd98380 x1876618815476352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683222.498143:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815476352:0@lo:400: 00000100:00100000:3.0:1789683222.498278:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815476224 00000100:00100000:3.0:1789683222.498283:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815476224 00000100:00100000:3.0:1789683222.498313:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683222.498320:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:3303:x1876618815476224:12345-0@lo:400: 00000100:00100000:3.0:1789683222.498354:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:3303:x1876618815476224:12345-0@lo:400: Request processed in 35us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683222.498360:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683222.498476:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815476224:0@lo:400: 00010000:00010000:2.0:1789683222.816169:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789683223.322408:0:6672:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789683223.322412:0:6672:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1789683223.322621:0:6672:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dbe52f3c000 00000020:01000004:3.0:1789683223.322638:0:6672:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789683223.322650:0:6672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789683223.322664:0:6672:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dbe53060000) 00000020:00000080:3.0:1789683223.322725:0:6672:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789683223.345058:0:6672:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789683223.345303:0:6672:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789683223.368595:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789683223.374749:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789683223.374784:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789683223.374843:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789683223.374871:0:6672:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789683223.375228:0:6672:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789683223.375237:0:6672:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683223.375248:0:6672:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x59bee33f93fe782 00000020:01000004:3.0:1789683223.375256:0:6672:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789683223.375277:0:6672:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789683223.375281:0:6672:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789683223.375287:0:6672:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789683223.375291:0:6672:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789683223.375306:0:6672:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8dbe48488000) 00000020:00000080:3.0:1789683223.375316:0:6672:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789683223.376350:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683223.376660:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789683223.376666:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789683223.377417:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789683223.377425:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789683223.378839:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789683223.378849:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789683223.380226:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683223.381112:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789683223.381121:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1789683223.384385:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1789683223.384407:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789683223.405528:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683223.405906:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789683223.405914:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789683223.407050:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789683223.407058:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1789683223.409018:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789683223.409029:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789683223.414892:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683223.415169:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789683223.415177:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1789683223.416014:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1789683223.416023:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789683223.459410:0:6672:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683223.459758:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789683223.459767:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789683223.460883:0:6672:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789683223.460893:0:6672:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789683223.461251:0:6672:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789683223.461273:0:6672:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1789683223.461281:0:6672:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789683223.482253:0:6672:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789683223.482289:0:6672:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1789683223.482293:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789683223.482295:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683223.482297:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683223.482298:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683223.482299:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683223.482300:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683223.482302:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683223.482304:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683223.482305:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683223.482307:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683223.482308:0:6672:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683223.482311:0:6672:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1789683223.482314:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683223.482315:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683223.482316:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683223.482318:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683223.482319:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683223.482320:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683223.482321:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683223.482322:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789683223.482323:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789683223.482324:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683223.482325:0:6672:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683223.482359:0:6672:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789683223.482377:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815476480:0@lo:253: 00000100:00100000:0.0:1789683223.482462:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683223.482593:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe62011840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683223.482878:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815476480 00000100:00100000:3.0:1789683223.482886:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815476480 00000100:00100000:3.0:1789683223.482975:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683223.482985:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815476480:12345-0@lo:253: 20000000:01000000:3.0:1789683223.483023:0:5823:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789683223.483027:0:5823:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1789683223.483032:0:5823:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1789683223.483036:0:5823:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789683223.484173:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683223.484415:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789683223.484434:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789683223.484472:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789683223.484482:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789683223.484514:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789683223.484641:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1789683223.485062:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789683223.485081:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.160@tcp 20000000:01000000:2.0:1789683223.485084:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:2.0:1789683223.485120:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789683223.485128:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789683223.485173:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789683223.485182:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:2.0:1789683223.485214:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789683223.485224:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789683223.485255:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789683223.485309:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1789683223.486467:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1789683223.486494:0:5823:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.160@tcp 20000000:01000000:2.0:1789683223.486497:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:2.0:1789683223.486529:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1789683223.486537:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789683223.486643:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1789683223.486659:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:2.0:1789683223.486787:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1789683223.486798:0:5823:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789683223.487474:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1789683223.487519:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1789683223.487538:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789683223.487541:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789683223.487544:0:5823:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789683223.487633:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789683223.487637:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789683223.487824:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789683223.487828:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789683223.488375:0:6687:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789683223.488441:0:6687:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789683223.488496:0:6687:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1789683223.488868:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1789683223.488910:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1789683223.488965:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1789683223.488978:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789683223.488980:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789683223.489460:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789683223.489513:0:6688:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1789683223.489634:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1789683223.489955:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1789683223.489996:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1789683223.490030:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1789683223.490041:0:5823:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789683223.490043:0:5823:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1789683223.490410:0:6689:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789683223.490829:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789683223.490875:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789683223.490933:0:5823:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789683223.490949:0:5823:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1789683223.490952:0:5823:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1789683223.490960:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789683223.490979:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.490996:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe6a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe6a2 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.491016:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe6c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe6be expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.491022:0:5823:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe72e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.491029:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.491066:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe72e expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.491079:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe72e expref: 12 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.491093:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5823:1876618815476608:0@lo:104: 00000100:00100000:2.0:1789683223.491152:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683223.491252:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe6c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe6be expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.491261:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe6c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe6be expref: 12 pid: 5821 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.491269:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5823:1876618815476736:0@lo:104: 00000100:00100000:2.0:1789683223.491301:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683223.491413:0:5823:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe6a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe6a2 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.491423:0:5823:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe6a2 expref: 12 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.491439:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5823:1876618815476864:0@lo:104: 00000100:00100000:2.0:1789683223.491461:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.491518:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815476608 00000100:00100000:1.0:1789683223.491525:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815476608 00000100:00100000:1.0:1789683223.491569:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815476736 00000100:00100000:1.0:1789683223.491573:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815476736 00000100:00100000:1.0:1789683223.491588:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683223.491596:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+4:5823:x1876618815476608:12345-0@lo:104: 00010000:00010000:1.0:1789683223.491608:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d200/0x59bee33f93fe72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491664:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683223.491670:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+4:5823:x1876618815476608:12345-0@lo:104: Request processed in 75us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683223.491694:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683223.491710:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683223.491716:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5823:x1876618815476736:12345-0@lo:104: 00010000:00010000:1.0:1789683223.491724:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe44430600/0x59bee33f93fe6be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491754:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789683223.491759:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5823:x1876618815476736:12345-0@lo:104: Request processed in 44us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683223.491764:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1789683223.491780:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683223.491785:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d200/0x59bee33f93fe72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491804:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d200 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:1.0:1789683223.491807:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d200/0x59bee33f93fe72e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491816:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d200/0x59bee33f93fe72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683223.491823:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d200/0x59bee33f93fe72e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683223.491830:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683223.491854:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d200/0x59bee33f93fe72e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491860:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683223.491878:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d200/0x59bee33f93fe72e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491885:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d200/0x59bee33f93fe72e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe735 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491897:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683223.491900:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe44430600/0x59bee33f93fe6be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491905:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44430600 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:1.0:1789683223.491908:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe44430600/0x59bee33f93fe6be lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491924:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe44430600/0x59bee33f93fe6be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683223.491930:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe44430600/0x59bee33f93fe6be lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683223.491936:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683223.491948:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe44430600/0x59bee33f93fe6be lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491954:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683223.491960:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe44430600/0x59bee33f93fe6be lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491966:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe44430600/0x59bee33f93fe6be lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe6c5 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.491977:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683223.491978:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683223.491980:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683223.491992:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815476992:0@lo:103: 00000100:00100000:1.0:1789683223.492018:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.492038:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683223.492043:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815477120:0@lo:103: 00000100:00100000:1.0:1789683223.492060:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.492087:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815476992 00000100:00100000:1.0:1789683223.492091:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815476992 00010000:00010000:1.0:1789683223.492108:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe735 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe72e expref: 13 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683223.492138:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815477120 00000100:00100000:1.0:1789683223.492141:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815477120 00010000:00010000:1.0:1789683223.492151:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe6c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe6be expref: 14 pid: 5821 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683223.492163:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683223.492169:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+14:3304:x1876618815476992:12345-0@lo:103: 00010000:00010000:1.0:1789683223.492178:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683223.492183:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe735 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe72e expref: 14 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.492192:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe72e expref: 14 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.492206:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683223.492235:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+14:3304:x1876618815476992:12345-0@lo:103: Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683223.492241:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683223.492252:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683223.492258:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+13:3304:x1876618815477120:12345-0@lo:103: 00010000:00010000:1.0:1789683223.492265:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683223.492269:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe6c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe6be expref: 13 pid: 5821 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.492277:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe6c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe6be expref: 13 pid: 5821 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.492286:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683223.492313:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+13:3304:x1876618815477120:12345-0@lo:103: Request processed in 55us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683223.492319:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683223.492353:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815477120:0@lo:103: 00000100:00100000:1.0:1789683223.492361:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815476992:0@lo:103: 00010000:00010000:3.0:1789683223.492504:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683223.492689:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f2b240 going to sleep for 11 seconds 00010000:00010000:2.0:1789683223.492703:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe72e expref: 12 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.492714:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5823:1876618815476608:0@lo:104: 00010000:00010000:2.0:1789683223.492722:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe6c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe6be expref: 11 pid: 5821 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.492732:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5823:1876618815476736:0@lo:104: 00000100:00100000:1.0:1789683223.492781:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815476864 00000100:00100000:1.0:1789683223.492786:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815476864 00000100:00100000:1.0:1789683223.492804:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683223.492810:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5823:x1876618815476864:12345-0@lo:104: 00010000:00010000:1.0:1789683223.492819:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3800/0x59bee33f93fe6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.492900:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683223.492907:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5823:x1876618815476864:12345-0@lo:104: Request processed in 96us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683223.492913:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789683223.492961:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683223.492966:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3800/0x59bee33f93fe6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.492973:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3800 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683223.492976:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3800/0x59bee33f93fe6a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.492984:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3800/0x59bee33f93fe6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683223.493001:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3800/0x59bee33f93fe6a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683223.493006:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683223.493033:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3800/0x59bee33f93fe6a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493040:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683223.493054:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3800/0x59bee33f93fe6a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493062:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3800/0x59bee33f93fe6a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe6a9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493076:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683223.493078:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683223.493080:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683223.493089:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815477248:0@lo:103: 00000100:00100000:3.0:1789683223.493117:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683223.493151:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815477248 00000100:00100000:3.0:1789683223.493156:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815477248 00010000:00010000:3.0:1789683223.493170:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe6a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe6a2 expref: 11 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683223.493187:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683223.493193:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+11:3302:x1876618815477248:12345-0@lo:103: 00010000:00010000:3.0:1789683223.493200:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683223.493204:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe6a9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe6a2 expref: 11 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493218:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe6a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe6a2 expref: 11 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493230:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493238:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493253:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493261:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493269:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493276:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493281:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8de00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683223.493285:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493292:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493300:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.493320:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683223.493346:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+11:3302:x1876618815477248:12345-0@lo:103: Request processed in 152us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683223.493352:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683223.493380:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815477248:0@lo:103: 00010000:00010000:2.0:1789683223.493545:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe6a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe6a2 expref: 10 pid: 5822 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.493623:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5823:1876618815476864:0@lo:104: 00010000:00010000:2.0:1789683223.493646:0:5823:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.493655:0:5823:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.493661:0:5823:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.493667:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8de00/0x59bee33f93fe790 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789683223.493825:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1789683223.531439:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+9:6672:x1876618815476480:12345-0@lo:253: Request processed in 48448us (48968us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.531455:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683223.531543:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815476480:0@lo:253: 10000000:01000000:3.0:1789683223.531557:0:6672:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789683223.531560:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789683223.531562:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789683223.531563:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683223.531564:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789683223.531565:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683223.531566:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683223.531568:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683223.531569:0:6672:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789683223.531571:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683223.531572:0:6672:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789683223.531591:0:6672:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dbe52f3c000 from lustre-OST0000 10000000:01000000:3.0:1789683223.531635:0:6672:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789683223.531638:0:6672:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789683223.531645:0:6672:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dbe48a44d40 local copy 10000000:01000000:3.0:1789683223.531650:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789683223.531756:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.531766:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.531777:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683223.531806:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815477376:0@lo:101: 00000100:00100000:3.0:1789683223.531842:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683223.531941:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe627c5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683223.532040:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815477376 00000100:00100000:0.0:1789683223.532046:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815477376 00000100:00100000:0.0:1789683223.532125:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789683223.532134:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+9:6672:x1876618815477376:12345-0@lo:101: 00010000:00010000:0.0:1789683223.532147:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683223.532160:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe79e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe797 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.532182:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe797 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.532192:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe79e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe797 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.532201:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe44430a00, rc 0) 00000100:00100000:0.0:1789683223.532243:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+10:6672:x1876618815477376:12345-0@lo:101: Request processed in 111us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.532250:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683223.532323:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815477376:0@lo:101: 00010000:00010000:1.0:1789683223.532335:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.532344:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683223.532455:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815477504:0@lo:501: 00000100:00100000:1.0:1789683223.532480:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.532647:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe60ca4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683223.532762:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815477504 00000100:00100000:3.0:1789683223.532768:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815477504 00000100:00100000:3.0:1789683223.532791:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683223.532798:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+10:6672:x1876618815477504:12345-0@lo:501: 00000100:00100000:3.0:1789683223.532997:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+10:6672:x1876618815477504:12345-0@lo:501: Request processed in 199us (515us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789683223.533005:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683223.533085:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815477504:0@lo:501: 10000000:01000000:1.0:1789683223.533105:0:6672:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789683223.533129:0:6672:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789683223.533134:0:6672:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.533143:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.533150:0:6672:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.533173:0:6672:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789683223.533191:0:6672:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dbe52f3c000 10000000:01000000:1.0:1789683223.533196:0:6672:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789683223.533200:0:6672:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8dbe48a44d40 10000000:01000000:1.0:1789683223.533202:0:6672:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1789683223.533206:0:6672:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dbe48a44d40 from 1 10000000:01000000:1.0:1789683223.533208:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1789683223.533225:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.533232:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.533241:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683223.533253:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815477632:0@lo:101: 00000100:00100000:1.0:1789683223.533277:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.533304:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5445ba80 going to sleep for 11 seconds 00010000:00010000:3.0:1789683223.533431:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683223.533436:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.533443:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9e00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683223.533447:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.533455:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683223.533462:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683223.533468:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683223.533484:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.533499:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683223.533524:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.533532:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9e00/0x59bee33f93fe797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x59bee33f93fe79e expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.533547:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683223.533548:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683223.533550:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683223.533556:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683223.533566:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815477760:0@lo:103: 00000100:00100000:3.0:1789683223.533592:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683223.533620:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815477760 00000100:00100000:3.0:1789683223.533624:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815477760 00000100:00100000:3.0:1789683223.533650:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789683223.533656:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+10:3302:x1876618815477760:12345-0@lo:103: 00010000:00010000:3.0:1789683223.533664:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683223.533704:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe44430a00/0x59bee33f93fe79e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe797 expref: 10 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.533717:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683223.533743:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+9:3302:x1876618815477760:12345-0@lo:103: Request processed in 87us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683223.533748:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789683223.533781:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815477760:0@lo:103: 00000100:00100000:3.0:1789683223.533795:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815477632 00000100:00100000:3.0:1789683223.533803:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815477632 00000100:00100000:3.0:1789683223.533820:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789683223.533826:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+9:6672:x1876618815477632:12345-0@lo:101: 00010000:00010000:3.0:1789683223.533833:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683223.533842:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8c00/0x59bee33f93fe7ac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe7a5 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.533856:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8c00/0x59bee33f93fe7ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe7a5 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.533865:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea8c00/0x59bee33f93fe7ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe7a5 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.533872:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8c00, rc 0) 00000100:00100000:3.0:1789683223.533898:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+10:6672:x1876618815477632:12345-0@lo:101: Request processed in 73us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683223.533904:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789683223.533980:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815477632:0@lo:101: 00010000:00010000:1.0:1789683223.533992:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7ac expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.534001:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe7ac expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683223.534016:0:6672:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789683223.534030:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7ac expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.534038:0:6672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7ac expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683223.534043:0:6672:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789683223.534047:0:6672:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789683223.534052:0:6672:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789683223.534055:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789683223.534068:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.534075:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.534081:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683223.534092:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815477888:0@lo:101: 00000100:00100000:1.0:1789683223.534114:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.534137:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5445ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683223.534193:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815477888 00000100:00100000:3.0:1789683223.534197:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815477888 00000100:00100000:3.0:1789683223.534212:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683223.534217:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+10:6672:x1876618815477888:12345-0@lo:101: 00010000:00010000:3.0:1789683223.534224:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683223.534231:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe7b3 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.534243:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe7b3 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.534250:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe7b3 expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683223.534266:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9400, rc 0) 00000100:00100000:3.0:1789683223.534388:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815477888:12345-0@lo:101: Request processed in 170us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683223.534404:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789683223.534567:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815477888:0@lo:101: 00010000:00010000:1.0:1789683223.534578:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.534585:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683223.534655:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478016:0@lo:501: 00000100:00100000:1.0:1789683223.534782:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.534808:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5445ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683223.534811:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815478016 00000100:00100000:3.0:1789683223.534815:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815478016 00000100:00100000:3.0:1789683223.534841:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683223.534847:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815478016:12345-0@lo:501: 00000100:00100000:3.0:1789683223.535010:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815478016:12345-0@lo:501: Request processed in 163us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683223.535015:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1789683223.535064:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478016:0@lo:501: 00000100:00100000:1.0:1789683223.535225:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478144:0@lo:503: 00000100:00100000:1.0:1789683223.535263:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.535283:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5445ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683223.535337:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815478144 00000100:00100000:2.0:1789683223.535341:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815478144 00000100:00100000:2.0:1789683223.535375:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683223.535381:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815478144:12345-0@lo:503: 00000100:00100000:2.0:1789683223.535583:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815478144:12345-0@lo:503: Request processed in 201us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683223.535590:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789683223.535649:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478144:0@lo:503: 00000040:00080000:1.0:1789683223.536019:0:6672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683223.536091:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478272:0@lo:502: 00000100:00100000:1.0:1789683223.536128:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.536161:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe540dfc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683223.536248:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815478272 00000100:00100000:0.0:1789683223.536254:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815478272 00000100:00100000:0.0:1789683223.536291:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789683223.536300:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815478272:12345-0@lo:502: 00000100:00100000:0.0:1789683223.536469:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815478272:12345-0@lo:502: Request processed in 170us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.536476:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789683223.536560:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478272:0@lo:502: 00000040:00080000:1.0:1789683223.536896:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789683223.536945:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789683223.536980:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789683223.537016:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789683223.537035:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789683223.537066:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789683223.537089:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478400:0@lo:502: 00000100:00100000:1.0:1789683223.537117:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.537179:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5445ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683223.537209:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815478400 00000100:00100000:2.0:1789683223.537213:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815478400 00000100:00100000:2.0:1789683223.537237:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789683223.537243:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815478400:12345-0@lo:502: 00000100:00100000:2.0:1789683223.537424:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815478400:12345-0@lo:502: Request processed in 181us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683223.537432:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789683223.537495:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478400:0@lo:502: 00000040:00080000:1.0:1789683223.537570:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789683223.537582:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1789683223.538103:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683223.538112:0:6690:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789683223.538118:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683223.538120:0:6690:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789683223.538126:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683223.538139:0:6690:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dbe7d6419c0) 00000020:00000080:1.0:1789683223.538158:0:6690:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789683223.538164:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789683223.538230:0:6690:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe52f3c000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789683223.538237:0:6690:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789683223.538243:0:6690:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x59bee33f93fe7c8 00010000:00010000:1.0:1789683223.547226:0:6690:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1789683223.548109:0:6690:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1789683223.551244:0:6690:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1789683223.551556:0:6690:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:1.0:1789683223.561129:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1789683223.561642:0:6690:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789683223.563371:0:6690:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789683223.563384:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683223.563390:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683223.563402:0:6690:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789683223.563407:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683223.563411:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683223.563413:0:6690:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789683223.563415:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789683223.563417:0:6690:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789683223.563468:0:6690:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683223.563471:0:6690:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683223.563473:0:6690:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789683223.563476:0:6690:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789683223.563860:0:6672:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789683223.563889:0:6672:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789683223.563913:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.563924:0:6672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683223.563945:0:6672:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe52f3c000 from 1 10000000:01000000:1.0:1789683223.563948:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683223.563980:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.563988:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.563998:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683223.564019:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478528:0@lo:101: 00000100:00100000:1.0:1789683223.564082:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.564123:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683223.565095:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815478528 00000100:00100000:0.0:1789683223.565105:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815478528 00000100:00100000:0.0:1789683223.565160:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683223.565171:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+11:6672:x1876618815478528:12345-0@lo:101: 00010000:00010000:0.0:1789683223.565187:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683223.565202:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe7cf expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.565227:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe7cf expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.565251:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe7cf expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.565260:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe44430600, rc 0) 00000100:00100000:0.0:1789683223.565313:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815478528:12345-0@lo:101: Request processed in 145us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.565320:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789683223.565388:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478528:0@lo:101: 00010000:00010000:1.0:1789683223.565415:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.565426:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683223.565524:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478656:0@lo:501: 00000100:00100000:1.0:1789683223.565552:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.565584:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683223.566487:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815478656 00000100:00100000:0.0:1789683223.566495:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815478656 00000100:00100000:0.0:1789683223.566526:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789683223.566532:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815478656:12345-0@lo:501: 00000100:00100000:0.0:1789683223.566791:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815478656:12345-0@lo:501: Request processed in 258us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.566799:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789683223.566862:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478656:0@lo:501: 00000100:00100000:1.0:1789683223.566899:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478784:0@lo:503: 00000100:00100000:1.0:1789683223.566950:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.567000:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683223.573529:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815478784 00000100:00100000:0.0:1789683223.573544:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815478784 00000100:00100000:0.0:1789683223.573602:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789683223.573613:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815478784:12345-0@lo:503: 00000100:00100000:0.0:1789683223.574036:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815478784:12345-0@lo:503: Request processed in 424us (7085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.574045:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789683223.574212:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478784:0@lo:503: 00000040:00080000:1.0:1789683223.574497:0:6672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789683223.574560:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478912:0@lo:502: 00000100:00100000:1.0:1789683223.574603:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.574642:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683223.577557:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815478912 00000100:00100000:0.0:1789683223.577570:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815478912 00000100:00100000:0.0:1789683223.577621:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789683223.577631:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815478912:12345-0@lo:502: 00000100:00100000:0.0:1789683223.577935:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815478912:12345-0@lo:502: Request processed in 304us (3331us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.577949:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683223.581984:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815478912:0@lo:502: 00000040:00080000:3.0:1789683223.582304:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1789683223.582509:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1789683223.582554:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479040:0@lo:502: 00000100:00100000:3.0:1789683223.582627:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683223.582704:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683223.582794:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815479040 00000100:00100000:2.0:1789683223.582802:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815479040 00000100:00100000:2.0:1789683223.582845:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789683223.582855:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815479040:12345-0@lo:502: 00000100:00100000:2.0:1789683223.583065:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815479040:12345-0@lo:502: Request processed in 210us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683223.583073:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683223.583164:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479040:0@lo:502: 00000040:00080000:3.0:1789683223.583275:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789683223.583293:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789683223.584140:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683223.584151:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683223.584154:0:6694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789683223.584160:0:6694:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe52f3c000 00000020:00000080:3.0:1789683223.584163:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683223.584184:0:6694:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683223.584193:0:6694:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683223.584194:0:6694:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789683223.584198:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789683223.584299:0:6672:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789683223.584315:0:6672:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683223.584355:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.584364:0:6672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683223.584418:0:6672:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683223.584421:0:6672:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dbe52f3c000 10000000:01000000:2.0:1789683223.584424:0:6672:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dbe52f3c000 10000000:01000000:2.0:1789683223.584428:0:6672:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683223.584433:0:6672:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe52f3c000 from 1 10000000:01000000:2.0:1789683223.584436:0:6672:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683223.584466:0:6672:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.584475:0:6672:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.584485:0:6672:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.584503:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479168:0@lo:101: 00000100:00100000:2.0:1789683223.584549:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683223.584585:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe530a1480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683223.584710:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815479168 00000100:00100000:0.0:1789683223.584717:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815479168 00000100:00100000:0.0:1789683223.584750:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683223.584757:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815479168:12345-0@lo:101: 00010000:00010000:0.0:1789683223.584767:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683223.584779:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe7dd expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.584798:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe7dd expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.584809:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe7dd expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.584817:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe44430200, rc 0) 00000100:00100000:0.0:1789683223.584864:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815479168:12345-0@lo:101: Request processed in 108us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.584870:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789683223.585020:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479168:0@lo:101: 00010000:00010000:1.0:1789683223.585034:0:6672:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.585043:0:6672:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683223.585128:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479296:0@lo:501: 00000100:00100000:1.0:1789683223.585154:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.585213:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb540 going to sleep for 11 seconds 00000100:00100000:0.0:1789683223.585318:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815479296 00000100:00100000:0.0:1789683223.585323:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815479296 00000100:00100000:0.0:1789683223.585440:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789683223.585449:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815479296:12345-0@lo:501: 00000100:00100000:0.0:1789683223.585658:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815479296:12345-0@lo:501: Request processed in 209us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.585665:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789683223.585745:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479296:0@lo:501: 00000100:00100000:3.0:1789683223.585769:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479424:0@lo:503: 00000100:00100000:3.0:1789683223.585802:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683223.585815:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83000 going to sleep for 11 seconds 00000100:00100000:2.0:1789683223.585870:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815479424 00000100:00100000:2.0:1789683223.585874:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815479424 00000100:00100000:2.0:1789683223.585892:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683223.585897:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815479424:12345-0@lo:503: 00000100:00100000:2.0:1789683223.586051:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815479424:12345-0@lo:503: Request processed in 153us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683223.586058:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683223.586213:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479424:0@lo:503: 00000040:00080000:3.0:1789683223.586536:0:6672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683223.586585:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479552:0@lo:502: 00000100:00100000:3.0:1789683223.586622:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683223.586719:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83000 going to sleep for 11 seconds 00000100:00100000:2.0:1789683223.586850:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815479552 00000100:00100000:2.0:1789683223.586856:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815479552 00000100:00100000:2.0:1789683223.586919:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789683223.586939:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815479552:12345-0@lo:502: 00000100:00100000:2.0:1789683223.587107:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815479552:12345-0@lo:502: Request processed in 169us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683223.587114:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683223.587177:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479552:0@lo:502: 00000040:00080000:3.0:1789683223.587643:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1789683223.587734:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1789683223.587772:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1789683223.587834:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1789683223.587873:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1789683223.587924:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1789683223.587975:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1789683223.588012:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1789683223.588062:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1789683223.588100:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1789683223.588135:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1789683223.588185:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1789683223.588222:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1789683223.588258:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1789683223.588307:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1789683223.588345:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1789683223.588403:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1789683223.588458:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1789683223.588496:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1789683223.588531:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1789683223.588580:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1789683223.588617:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1789683223.588667:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1789683223.588744:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1789683223.588782:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1789683223.588818:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1789683223.588867:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1789683223.588904:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1789683223.588945:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479680:0@lo:502: 00000100:00100000:3.0:1789683223.589010:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683223.589601:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683223.589669:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815479680 00000100:00100000:1.0:1789683223.589705:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815479680 00000100:00100000:1.0:1789683223.589742:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789683223.589752:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815479680:12345-0@lo:502: 00000100:00100000:1.0:1789683223.589964:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815479680:12345-0@lo:502: Request processed in 213us (953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683223.589972:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683223.590112:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815479680:0@lo:502: 00000040:00080000:3.0:1789683223.590192:0:6672:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1789683223.590203:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1789683223.591072:0:6695:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789683223.591086:0:6695:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dbe7d640000) 00000020:00000080:1.0:1789683223.591105:0:6695:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1789683223.591192:0:6695:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe52f3c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789683223.591197:0:6695:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dbe52f3c000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789683223.591200:0:6695:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe52f3c000 3 00010000:00080000:1.0:1789683223.591225:0:6695:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbd44f46800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1789683223.596998:0:6695:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1789683223.597431:0:6695:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789683223.597472:0:6695:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789683223.597485:0:6695:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x59bee33f93fe7f2 00000100:00080000:1.0:1789683223.597494:0:6695:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683223.597506:0:6695:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dbd44f46800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1789683223.597539:0:6695:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe7c526d80 x1876618815479808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789683223.597600:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876618815479808:0@lo:38: 00000100:00100000:3.0:1789683223.597666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683223.597780:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815479808 00000100:00100000:0.0:1789683223.597788:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815479808 00000100:00100000:0.0:1789683223.597831:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683223.597838:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876618815479808:12345-0@lo:38: 00010000:00080000:0.0:1789683223.597861:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 157 last 0 00000020:00000080:0.0:1789683223.597891:0:5831:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x59bee33f93fe7f9 00000004:00100000:0.0:1789683223.597906:0:5831:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789683223.597936:0:5831:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bc42800 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1789683223.598010:0:6695:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789683223.598869:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815479936:0@lo:400: 00000100:00100000:1.0:1789683223.598912:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683223.598963:0:5829:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789683223.598971:0:5829:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789683223.600404:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876618815479808:12345-0@lo:38: Request processed in 2547us (2720us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.600418:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683223.600443:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815479936 00000100:00100000:0.0:1789683223.600449:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815479936 00000100:00100000:0.0:1789683223.600493:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683223.600501:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815479936:12345-0@lo:400: 00000100:00100000:0.0:1789683223.600566:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815479936:12345-0@lo:400: Request processed in 66us (1654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683223.600571:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789683223.600612:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dbe7c524700 x1876618815479936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683239 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683223.600626:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815479936:0@lo:400: 00010000:00080000:3.0:1789683223.603840:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dbe7c526d80 x1876618815479808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683223.603856:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683223.603865:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1789683223.603873:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789683223.603878:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789683223.603882:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbd44f46800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789683223.603888:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876618815479808:0@lo:38: 00000040:00080000:0.0:1789683223.605924:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789683223.606107:0:6672:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789683223.606132:0:6672:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683223.606154:0:6672:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.606166:0:6672:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789683223.606215:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789683223.606217:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789683223.606219:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683223.606220:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683223.606221:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683223.606223:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683223.606224:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683223.606226:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683223.606227:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683223.606229:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683223.606230:0:6672:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683223.606234:0:6672:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789683223.606525:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683223.606528:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789683223.606529:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683223.606530:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683223.606531:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683223.606533:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683223.606534:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683223.606535:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683223.606536:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683223.606537:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683223.606538:0:6672:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683223.606582:0:6672:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789683223.606600:0:6672:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815480064:0@lo:253: 00000100:00100000:2.0:1789683223.606667:0:6672:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683223.606928:0:6672:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54aeb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683223.606970:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815480064 00000100:00100000:1.0:1789683223.606978:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815480064 00000100:00100000:1.0:1789683223.607051:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789683223.607061:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:6672:x1876618815480064:12345-0@lo:253: 20000000:01000000:1.0:1789683223.607086:0:5821:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789683223.607099:0:5821:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789683223.626040:0:5821:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789683223.626084:0:5821:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789683223.627974:0:5845:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789683223.627982:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789683223.628005:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.628023:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe766 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe75f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.628049:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.628086:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe75f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.628101:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe75f expref: 13 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683223.628114:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1876618815480192:0@lo:104: 00000100:00100000:0.0:1789683223.628177:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683223.628444:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789683223.628587:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815480192 00000100:00100000:1.0:1789683223.628596:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815480192 00000100:00100000:1.0:1789683223.628648:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683223.628659:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5845:x1876618815480192:12345-0@lo:104: 00010000:00010000:1.0:1789683223.628695:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.628762:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683223.628769:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5845:x1876618815480192:12345-0@lo:104: Request processed in 113us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683223.628776:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789683223.628798:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683223.628803:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.628811:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3200 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:1.0:1789683223.628815:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe75f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.628824:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683223.628831:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe75f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683223.628837:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683223.628863:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe75f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.628869:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789683223.628871:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1876618815480192:0@lo:104: 00010000:00010000:1.0:1789683223.628884:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe75f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.628891:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.628891:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe75f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe766 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683223.628910:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683223.628912:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683223.628914:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683223.628925:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815480320:0@lo:103: 00000100:00100000:1.0:1789683223.628958:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683223.629512:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815480320 00000100:00100000:2.0:1789683223.629518:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815480320 00010000:00010000:2.0:1789683223.629601:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe75f expref: 14 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.629723:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683223.629732:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+14:3305:x1876618815480320:12345-0@lo:103: 00010000:00010000:2.0:1789683223.629745:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683223.629752:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe766 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe75f expref: 14 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629764:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe766 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe75f expref: 14 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629777:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe766 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe75f expref: 14 pid: 5823 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629791:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629798:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789683223.629824:0:5814:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002548946s 00010000:00010000:2.0:1789683223.629829:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629836:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629843:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629850:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629855:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44431e00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683223.629859:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629866:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629887:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683223.629897:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683223.629928:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683223.629938:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.629940:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496c6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+13:3305:x1876618815480320:12345-0@lo:103: Request processed in 209us (981us total) trans 0 rc 0/0 00010000:00010000:0.0:1789683223.629954:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe800 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683223.629958:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683223.630018:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815480320:0@lo:103: 00000100:00100000:1.0:1789683223.632061:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:6672:x1876618815480064:12345-0@lo:253: Request processed in 24996us (25388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683223.632073:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683223.632151:0:6672:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:6672:1876618815480064:0@lo:253: 10000000:01000000:2.0:1789683223.632165:0:6672:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789683223.632179:0:6672:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789683223.632181:0:6672:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789683223.632182:0:6672:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683223.632183:0:6672:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683223.632184:0:6672:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683223.632185:0:6672:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683223.632186:0:6672:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683223.632188:0:6672:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683223.632189:0:6672:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683223.632190:0:6672:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683223.632192:0:6672:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789683223.632206:0:6672:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789683223.637565:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789683223.637767:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789683223.637940:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789683223.638097:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789683223.638285:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789683223.638547:0:6672:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789683223.640549:0:6672:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1789683223.812742:0:6672:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789683223.812749:0:6672:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789683223.812778:0:6672:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683223.812833:0:6672:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683223.812847:0:6672:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789683223.812864:0:6672:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789683223.840916:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789683224.671739:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789683224.671747:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe46fc8800 from 21 10000000:01000000:1.0:1789683224.671751:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683224.671805:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683224.671817:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683224.671829:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683224.671852:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815480448:0@lo:101: 00000100:00100000:1.0:1789683224.671914:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683224.671978:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683224.672265:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815480448 00000100:00100000:0.0:1789683224.672273:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815480448 00000100:00100000:3.0:1789683224.672446:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683224.672459:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:5825:x1876618815480448:12345-0@lo:101: 00010000:00010000:3.0:1789683224.672474:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683224.672486:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe807 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683224.672508:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe807 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683224.672801:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe807 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683224.672810:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9e00, rc 0) 00000100:00100000:3.0:1789683224.672870:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815480448:12345-0@lo:101: Request processed in 414us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683224.672877:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789683224.672996:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815480448:0@lo:101: 00010000:00010000:1.0:1789683224.673012:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683224.673033:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683224.673095:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815480576:0@lo:501: 00000100:00100000:1.0:1789683224.673334:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683224.673882:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683224.674465:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815480576 00000100:00100000:2.0:1789683224.674473:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815480576 00000100:00100000:2.0:1789683224.674517:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789683224.674526:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815480576:12345-0@lo:501: 00000100:00100000:2.0:1789683224.674787:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815480576:12345-0@lo:501: Request processed in 262us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683224.674794:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789683224.674887:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815480576:0@lo:501: 00000100:00100000:1.0:1789683224.674925:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815480704:0@lo:503: 00000100:00100000:1.0:1789683224.674968:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683224.674999:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413600 going to sleep for 11 seconds 00000100:00100000:3.0:1789683224.675146:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815480704 00000100:00100000:3.0:1789683224.675151:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815480704 00000100:00100000:3.0:1789683224.675181:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683224.675188:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815480704:12345-0@lo:503: 00000100:00100000:3.0:1789683224.675326:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815480704:12345-0@lo:503: Request processed in 138us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683224.675333:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789683224.675453:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815480704:0@lo:503: 00000100:00100000:3.0:1789683224.685088:0:6768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6768:1876618815480832:0@lo:502: 00000100:00100000:3.0:1789683224.685244:0:6768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683224.685315:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815480832 00000100:00100000:0.0:1789683224.685324:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815480832 00000100:00100000:3.0:1789683224.685331:0:6768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683224.685365:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789683224.685374:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:6768:x1876618815480832:12345-0@lo:502: 00000100:00100000:0.0:1789683224.685667:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:6768:x1876618815480832:12345-0@lo:502: Request processed in 293us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683224.685718:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789683224.685867:0:6768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6768:1876618815480832:0@lo:502: 00000100:00100000:2.0:1789683224.685985:0:6768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6768:1876618815480960:0@lo:502: 00000100:00100000:2.0:1789683224.686033:0:6768:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683224.686059:0:6768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683224.686145:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815480960 00000100:00100000:3.0:1789683224.686150:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815480960 00000100:00100000:3.0:1789683224.686184:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789683224.686191:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:6768:x1876618815480960:12345-0@lo:502: 00000100:00100000:3.0:1789683224.686413:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:6768:x1876618815480960:12345-0@lo:502: Request processed in 221us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683224.686420:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789683224.686549:0:6768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6768:1876618815480960:0@lo:502: 00000040:00080000:0.0:1789683224.686570:0:6768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1789683224.686970:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1789683224.686991:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683224.687001:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683224.687061:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683224.687071:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789683224.687081:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dbe46fc8800 from 4 10000000:01000000:2.0:1789683224.687084:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683224.687111:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683224.687118:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683224.687127:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683224.687139:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481088:0@lo:101: 00000100:00100000:2.0:1789683224.687172:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683224.687358:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683224.687488:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815481088 00000100:00100000:0.0:1789683224.687493:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815481088 00000100:00100000:0.0:1789683224.687571:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789683224.687580:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815481088:12345-0@lo:101: 00010000:00010000:0.0:1789683224.687591:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683224.687603:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe815 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683224.687623:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe815 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683224.687630:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe815 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683224.687636:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe44431e00, rc 0) 00000100:00100000:0.0:1789683224.687667:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815481088:12345-0@lo:101: Request processed in 88us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683224.687693:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789683224.687697:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481088:0@lo:101: 00010000:00010000:2.0:1789683224.687709:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683224.687718:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683224.687756:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481216:0@lo:256: 00000100:00100000:2.0:1789683224.687781:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683224.687806:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683224.687823:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815481216 00000100:00100000:3.0:1789683224.687827:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815481216 00000100:00100000:3.0:1789683224.687850:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789683224.687856:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815481216:12345-0@lo:256: 20000000:01000000:3.0:1789683224.687869:0:5823:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789683224.687884:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789683224.687887:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789683224.687969:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815481216:12345-0@lo:256: Request processed in 112us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683224.687984:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683224.687987:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481216:0@lo:256: 10000000:01000000:2.0:1789683224.688113:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789683224.688120:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683224.688138:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683224.688145:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789683224.688147:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1789683224.688150:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789683224.688163:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683224.688168:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683224.688173:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683224.688180:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481344:0@lo:101: 00000100:00100000:2.0:1789683224.688197:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683224.688213:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683224.688247:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815481344 00000100:00100000:0.0:1789683224.688250:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815481344 00000100:00100000:0.0:1789683224.688295:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789683224.688301:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815481344:12345-0@lo:101: 00010000:00010000:0.0:1789683224.688308:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683224.688316:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe823 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683224.688336:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe823 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683224.688344:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe823 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683224.688352:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe44430400, rc 0) 00000100:00100000:0.0:1789683224.688404:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815481344:12345-0@lo:101: Request processed in 102us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683224.688409:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789683224.688451:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481344:0@lo:101: 00010000:00010000:1.0:1789683224.688463:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683224.688472:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683224.688528:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481472:0@lo:501: 00000100:00100000:1.0:1789683224.688556:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683224.688573:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413600 going to sleep for 11 seconds 00000100:00100000:3.0:1789683224.688600:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815481472 00000100:00100000:3.0:1789683224.688605:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815481472 00000100:00100000:3.0:1789683224.688636:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789683224.688642:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815481472:12345-0@lo:501: 00000100:00100000:3.0:1789683224.688888:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815481472:12345-0@lo:501: Request processed in 246us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683224.688893:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683224.689154:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481472:0@lo:501: 00000100:00100000:1.0:1789683224.689184:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481600:0@lo:503: 00000100:00100000:1.0:1789683224.689232:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683224.689264:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683224.689274:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815481600 00000100:00100000:0.0:1789683224.689280:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815481600 00000100:00100000:0.0:1789683224.689310:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789683224.689316:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815481600:12345-0@lo:503: 00000100:00100000:0.0:1789683224.689479:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815481600:12345-0@lo:503: Request processed in 162us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683224.689486:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789683224.689522:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815481600:0@lo:503: 00000100:00100000:3.0:1789683224.689934:0:6769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6769:1876618815481728:0@lo:502: 00000100:00100000:3.0:1789683224.689969:0:6769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683224.690150:0:6769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683224.690188:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815481728 00000100:00100000:2.0:1789683224.690194:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815481728 00000100:00100000:2.0:1789683224.690255:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789683224.690262:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:6769:x1876618815481728:12345-0@lo:502: 00000100:00100000:2.0:1789683224.690478:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:6769:x1876618815481728:12345-0@lo:502: Request processed in 216us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683224.690485:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789683224.690555:0:6769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6769:1876618815481728:0@lo:502: 00000020:01000000:3.0:1789683224.690580:0:6769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683224.690587:0:6769:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789683224.690594:0:6769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683224.690597:0:6769:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1789683224.690605:0:6769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789683224.690608:0:6769:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:3.0:1789683224.690632:0:6769:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789683224.690635:0:6769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683224.690648:0:6769:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dbe4848cd40) 00000020:00000080:3.0:1789683224.690666:0:6769:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1789683224.690765:0:6769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789683224.690845:0:6769:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1789683224.690851:0:6769:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789683224.690858:0:6769:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93fe838 00010000:00080000:3.0:1789683224.690884:0:6769:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbe53b2c000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1789683224.691099:0:6769:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1789683224.746532:0:6769:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789683224.746556:0:6769:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789683224.747553:0:6769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683224.747798:0:6769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683224.747858:0:6769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1789683224.747922:0:6769:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1789683224.749002:0:6774:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683224.749007:0:6774:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789683224.752613:0:6769:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683224.752629:0:6769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789683224.752667:0:6769:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789683224.752705:0:6769:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93fe83f 00000100:00080000:1.0:1789683224.752716:0:6769:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683224.752728:0:6769:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dbe53b2c000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1789683224.752762:0:6769:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe7c526300 x1876618815481856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683224.752787:0:6769:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789683224.752840:0:6769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683224.752844:0:6769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683224.752846:0:6769:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789683224.752849:0:6769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683224.752852:0:6769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683224.752853:0:6769:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789683224.752856:0:6769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789683224.752859:0:6769:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1789683224.752884:0:6769:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6769:1876618815481984:0@lo:502: 00000100:00100000:0.0:1789683224.752913:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815481856:0@lo:8: 00000100:00100000:3.0:1789683224.753024:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815482112:0@lo:400: 00000100:00100000:0.0:1789683224.753128:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683224.753218:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815481856 00000100:00100000:0.0:1789683224.753225:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815481856 00000100:00100000:0.0:1789683224.753254:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683224.753261:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876618815481856:12345-0@lo:8: 00010000:00080000:0.0:1789683224.753281:0:6674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:0.0:1789683224.753306:0:6674:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93fe846 00002000:00100000:0.0:1789683224.753338:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dbe7bc42000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1789683224.753350:0:6674:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1789683224.753354:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:1.0:1789683224.753424:0:6769:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683224.753447:0:6769:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413240 going to sleep for 11 seconds 00002000:00100000:0.0:1789683224.753487:0:6674:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1789683224.753745:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815481984 00000100:00100000:1.0:1789683224.753750:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815481984 00000100:00100000:1.0:1789683224.753778:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789683224.753785:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+15:6769:x1876618815481984:12345-0@lo:502: 00000100:00100000:3.0:1789683224.754163:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683224.754260:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683224.754269:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815482240:0@lo:400: 00000100:00100000:3.0:1789683224.754299:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683224.754508:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815482112 00000100:00100000:0.0:1789683224.754514:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815482112 00000100:00100000:2.0:1789683224.754568:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815482240 00000100:00100000:2.0:1789683224.754573:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815482240 00000100:00100000:0.0:1789683224.754606:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683224.754617:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815482112:12345-0@lo:400: 00000100:00100000:2.0:1789683224.754622:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683224.754641:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815482240:12345-0@lo:400: 00000100:00100000:0.0:1789683224.754669:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815482112:12345-0@lo:400: Request processed in 54us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683224.754698:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683224.754722:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815482240:12345-0@lo:400: Request processed in 83us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683224.754729:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789683224.754751:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789683224.754793:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe48a5c000 x1876618815482240/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683224.754807:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815482240:0@lo:400: 00010000:00080000:3.0:1789683224.754820:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe48a5e300 x1876618815482112/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683224.754829:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815482112:0@lo:400: 00002000:00080000:0.0:1789683224.758957:0:6674:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789683224.758995:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bc44800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683224.759084:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876618815481856:12345-0@lo:8: Request processed in 5821us (5955us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683224.759094:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789683224.759148:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe7c526300 x1876618815481856/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683224.759160:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683224.759168:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789683224.759189:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789683224.759195:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789683224.759197:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe53b2c000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789683224.759209:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789683224.759214:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815481856:0@lo:8: 00000100:00100000:1.0:1789683224.761814:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+15:6769:x1876618815481984:12345-0@lo:502: Request processed in 8022us (8383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683224.761827:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789683224.761895:0:6769:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:6769:1876618815481984:0@lo:502: 00000020:01000000:1.0:1789683224.761929:0:6769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683224.761936:0:6769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683224.761939:0:6769:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789683224.761944:0:6769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1789683224.762424:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1789683224.762450:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789683224.762460:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683224.762472:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683224.762482:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789683224.762484:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dbe48a44d40 from 1 10000000:01000000:1.0:1789683224.762487:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789683224.762521:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683224.762529:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683224.762538:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683224.762565:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815482368:0@lo:101: 00000100:00100000:1.0:1789683224.762605:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683224.762642:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413240 going to sleep for 11 seconds 00000004:00080000:1.0:1789683224.762658:0:6774:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1789683224.762722:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815482368 00000100:00100000:3.0:1789683224.762730:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815482368 00000100:00100000:3.0:1789683224.762770:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789683224.762781:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815482368:12345-0@lo:101: 00010000:00010000:3.0:1789683224.762794:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000004:00080000:1.0:1789683224.762803:0:6774:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 158394129011ns, next at 0ns, rc = 0 00010000:00010000:3.0:1789683224.762807:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe84d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683224.762832:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe84d expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683224.762842:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe84d expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683224.762850:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8600, rc 0) 00000100:00100000:3.0:1789683224.762894:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815482368:12345-0@lo:101: Request processed in 115us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683224.762907:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789683224.763167:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815482368:0@lo:101: 00010000:00010000:1.0:1789683224.763416:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683224.763431:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683224.763482:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815482496:0@lo:501: 00000100:00100000:1.0:1789683224.763509:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683224.763532:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413240 going to sleep for 11 seconds 00000100:00100000:1.0:1789683224.763546:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815482496 00000100:00100000:1.0:1789683224.763550:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815482496 00000100:00100000:1.0:1789683224.763576:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789683224.763583:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815482496:12345-0@lo:501: 00000100:00100000:1.0:1789683224.763805:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815482496:12345-0@lo:501: Request processed in 222us (294us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683224.763813:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789683224.763845:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815482496:0@lo:501: 10000000:01000000:1.0:1789683224.763864:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789683224.763869:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683224.763883:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683224.806074:0:6775:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1789683224.806129:0:6775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6775:1876618815482752:0@lo:7: 00000100:00100000:3.0:1789683224.806229:0:6775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789683224.806246:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789683224.806311:0:6775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683224.806397:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815482624:0@lo:13: 00000100:00100000:0.0:1789683224.806555:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683224.807042:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815482624 00000100:00100000:3.0:1789683224.807052:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815482624 00000100:00100000:3.0:1789683224.807118:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789683224.807127:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815482624:12345-0@lo:13: 00002000:00000024:3.0:1789683224.807150:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3861905408 avail 3859808256 00000100:00100000:3.0:1789683224.807202:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815482624:12345-0@lo:13: Request processed in 76us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683224.807208:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789683224.807450:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683224.807577:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe48a5e300 x1876618815482624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683224.807598:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815482624:0@lo:13: 00000100:00100000:2.0:1789683224.808267:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815482752 00000100:00100000:2.0:1789683224.808275:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815482752 00000100:00100000:2.0:1789683224.808318:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683224.808328:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6775:x1876618815482752:12345-0@lo:7: 00002000:00080000:2.0:1789683224.817435:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789683224.817445:0:6676:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789683224.817541:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6775:x1876618815482752:12345-0@lo:7: Request processed in 9210us (11308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683224.817552:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789683224.818172:0:6775:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe48a5c000 x1876618815482752/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683240 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683224.818189:0:6775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6775:1876618815482752:0@lo:7: 00000004:00080000:3.0:1789683224.818204:0:6775:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789683224.818239:0:6775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6775:1876618815482880:0@lo:5: 00000100:00100000:3.0:1789683224.818283:0:6775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683224.818341:0:6775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683224.818455:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815482880 00000100:00100000:0.0:1789683224.818462:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815482880 00000100:00100000:0.0:1789683224.818518:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683224.818528:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6775:x1876618815482880:12345-0@lo:5: 00002000:00080000:0.0:1789683224.818563:0:6674:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789683224.818568:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789683224.818960:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6775:x1876618815482880:12345-0@lo:5: Request processed in 434us (676us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789683224.818968:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789683224.819019:0:6775:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe48a5c000 x1876618815482880/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683240 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683224.819031:0:6775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6775:1876618815482880:0@lo:5: 00000004:00080000:2.0:1789683224.819041:0:6775:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789683224.819067:0:6775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6775:1876618815483008:0@lo:700: 00000100:00100000:2.0:1789683224.819102:0:6775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683224.819131:0:6775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe544a4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683224.819425:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815483008 00000100:00100000:0.0:1789683224.819431:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815483008 00000100:00100000:0.0:1789683224.820949:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683224.820966:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6775:x1876618815483008:12345-0@lo:700: 00000100:00100000:0.0:1789683224.821016:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6683:1876618815483136:0@lo:700: 00000100:00100000:0.0:1789683224.821070:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683224.821100:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683224.821348:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815483136 00000100:00100000:2.0:1789683224.821355:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815483136 00000100:00100000:2.0:1789683224.821399:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683224.821407:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6683:x1876618815483136:12345-0@lo:700: 40000000:02000000:3.0:1789683224.852278:0:5836:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789683224.864193:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6683:x1876618815483136:12345-0@lo:700: Request processed in 42778us (43113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683224.864208:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789683224.864490:0:6683:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe6fef0e00 x1876618815483136/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789683240 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683224.864514:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6683:1876618815483136:0@lo:700: 40000000:02000000:0.0:1789683224.864539:0:6683:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:1.0:1789683224.872868:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683224.936001:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6775:x1876618815483008:12345-0@lo:700: Request processed in 115029us (116885us total) trans 0 rc 0/0 00000001:00080000:0.0:1789683224.936020:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:1.0:1789683224.936028:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00100000:0.0:1789683224.936046:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1789683224.936434:0:6775:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe7bd9aa00 x1876618815483008/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789683240 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683224.936454:0:6775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9aa00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6775:1876618815483008:0@lo:700: 00000004:02000040:0.0:1789683224.969768:0:6775:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789683224.975605:0:6775:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6775:1876618815483264:0@lo:5: 00000100:00100000:0.0:1789683224.975888:0:6775:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683224.975992:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815483264 00000100:00100000:3.0:1789683224.976002:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815483264 00000100:00100000:3.0:1789683224.976108:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683224.976119:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6775:x1876618815483264:12345-0@lo:5: 00000100:00100000:1.0:1789683224.976211:0:6775:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae9000 going to sleep for 11 seconds 00002000:00080000:3.0:1789683224.981813:0:6676:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789683224.981843:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1789683224.985256:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6775:x1876618815483264:12345-0@lo:5: Request processed in 9130us (9358us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789683224.985272:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1789683224.985665:0:6775:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe6fef0e00 x1876618815483264/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683240 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683224.985926:0:6775:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1789683224.985947:0:6775:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8dbe6fef0e00 x1876618815483264/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683240 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683224.985961:0:6775:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef0e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6775:1876618815483264:0@lo:5: 00000004:00080000:2.0:1789683224.985980:0:6775:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789683225.888030:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683226.914480:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683227.937836:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789683228.207790:0:7043:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789683228.966201:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683229.984054:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683230.176090:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815483392:0@lo:13: 00000100:00100000:2.0:1789683230.176135:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815483520:0@lo:400: 00000100:00100000:2.0:1789683230.176336:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683230.176412:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683230.176425:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815483648:0@lo:400: 00000100:00100000:2.0:1789683230.176457:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683230.176513:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815483776:0@lo:400: 00000100:00100000:2.0:1789683230.176559:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683230.176585:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815483648 00000100:00100000:0.0:1789683230.176594:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815483648 00000100:00100000:2.0:1789683230.176613:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815483776 00000100:00100000:2.0:1789683230.176619:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815483776 00000100:00100000:0.0:1789683230.176655:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683230.176666:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815483648:12345-0@lo:400: 00000100:00100000:2.0:1789683230.176703:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683230.176726:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815483776:12345-0@lo:400: 00000100:00100000:0.0:1789683230.176763:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815483648:12345-0@lo:400: Request processed in 99us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683230.176772:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815483776:12345-0@lo:400: Request processed in 48us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683230.176772:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683230.176791:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683230.176811:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815483520 00000100:00100000:0.0:1789683230.176816:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815483520 00000100:00100000:0.0:1789683230.176841:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789683230.176847:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+16:3302:x1876618815483520:12345-0@lo:400: 00000100:00100000:0.0:1789683230.179933:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+16:3302:x1876618815483520:12345-0@lo:400: Request processed in 3079us (3596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683230.179946:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789683230.179957:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683230.180008:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815483904:0@lo:400: 00000100:00080000:2.0:1789683230.180023:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683230.180043:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683230.180100:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815483904 00000100:00100000:2.0:1789683230.180106:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815483392 00000100:00100000:3.0:1789683230.180107:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815483904 00000100:00100000:2.0:1789683230.180113:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815483392 00000100:00100000:3.0:1789683230.180165:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683230.180176:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683230.180177:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815483904:12345-0@lo:400: 00010000:00080000:0.0:1789683230.180180:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe48a5fb80 x1876618815483776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683230.180194:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815483392:12345-0@lo:13: 00000100:00100000:0.0:1789683230.180196:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815483776:0@lo:400: 00002000:00000024:2.0:1789683230.180229:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683230.180232:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815483904:12345-0@lo:400: Request processed in 60us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683230.180240:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789683230.180240:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe48a5d880 x1876618815483648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683230.180249:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815483648:0@lo:400: 00000100:00100000:0.0:1789683230.180261:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815483520:0@lo:400: 00010000:00080000:3.0:1789683230.180269:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe48a5d500 x1876618815483904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683230.180279:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815483392:12345-0@lo:13: Request processed in 90us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683230.180280:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815483904:0@lo:400: 00000100:00100000:2.0:1789683230.180293:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789683230.180302:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe48a5ed80 x1876618815483392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683246 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683230.180317:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815483392:0@lo:13: 00000100:00080000:2.0:1789683230.180333:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1789683230.235970:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789683231.008100:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683232.032174:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683233.055824:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683234.079952:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683235.105127:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683235.296587:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683235.296609:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815484032:0@lo:13: 00000100:00100000:1.0:1789683235.296692:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683235.297133:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815484032 00000100:00100000:3.0:1789683235.297145:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815484032 00000100:00100000:3.0:1789683235.297409:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683235.297419:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815484032:12345-0@lo:13: 00002000:00000024:3.0:1789683235.297453:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683235.297531:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815484032:12345-0@lo:13: Request processed in 114us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683235.297538:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683235.297790:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815484288:0@lo:400: 00000100:00100000:0.0:1789683235.297827:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683235.297851:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683235.297857:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815484416:0@lo:400: 00000100:00100000:0.0:1789683235.297876:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683235.297904:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815484288 00000100:00100000:0.0:1789683235.297908:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815484288 00000100:00100000:0.0:1789683235.297934:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815484416 00000100:00100000:0.0:1789683235.297937:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815484416 00000100:00080000:2.0:1789683235.300436:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683235.300507:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683235.300525:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815484288:12345-0@lo:400: 00000100:00100000:2.0:1789683235.300611:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815484288:12345-0@lo:400: Request processed in 94us (2783us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683235.300618:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1789683235.300732:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683235.300835:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815484160:0@lo:400: 00010000:00080000:2.0:1789683235.300884:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe6fef1f80 x1876618815484288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683235.300884:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683235.300902:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815484288:0@lo:400: 00010000:00080000:1.0:1789683235.300937:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe7c524000 x1876618815484032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683251 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683235.300948:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789683235.300968:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815484032:0@lo:13: 00000100:00100000:1.0:1789683235.300992:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815484160 00000100:00100000:1.0:1789683235.300997:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815484160 00000100:00100000:1.0:1789683235.301029:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789683235.301037:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+16:3303:x1876618815484160:12345-0@lo:400: 00000100:00100000:1.0:1789683235.301078:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+16:3303:x1876618815484160:12345-0@lo:400: Request processed in 41us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683235.301085:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789683235.301134:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815484160:0@lo:400: 00000100:00100000:0.0:1789683235.302316:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683235.302327:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815484416:12345-0@lo:400: 00000100:00100000:0.0:1789683235.302387:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815484416:12345-0@lo:400: Request processed in 63us (4509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683235.302392:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789683235.302424:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe6fef2680 x1876618815484416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683251 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683235.302435:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815484416:0@lo:400: 00000020:01000004:3.0:1789683235.858111:0:7621:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789683235.858114:0:7621:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789683235.858218:0:7621:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dbe53b2b800 00000020:01000004:3.0:1789683235.858233:0:7621:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789683235.858251:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789683235.858264:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dbe4848b380) 00000020:00000080:3.0:1789683235.858279:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789683235.874380:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1789683235.875208:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789683235.895390:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789683235.900184:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789683235.900223:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789683235.900627:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789683235.900651:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789683235.901384:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789683235.901396:0:7621:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789683235.901406:0:7621:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x59bee33f93fe862 00000020:01000004:2.0:1789683235.901413:0:7621:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789683235.901431:0:7621:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789683235.901435:0:7621:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789683235.901440:0:7621:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789683235.901457:0:7621:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789683235.901460:0:7621:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789683235.917594:0:7621:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789683235.917636:0:7621:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.160@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789683235.917641:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789683235.917642:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683235.917643:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683235.917644:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683235.917646:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683235.917647:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683235.917648:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683235.917650:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789683235.917651:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789683235.917652:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683235.917653:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683235.917656:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789683235.917658:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789683235.917660:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683235.917661:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683235.917662:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683235.917663:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683235.917664:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683235.917669:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683235.917670:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789683235.917690:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789683235.917691:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683235.917692:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683235.917716:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789683235.917732:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815484544:0@lo:253: 00000100:00100000:3.0:1789683235.917808:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683235.917869:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe544a4c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683235.917989:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815484544 00000100:00100000:0.0:1789683235.917996:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815484544 00000100:00100000:0.0:1789683235.918038:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789683235.918047:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:7621:x1876618815484544:12345-0@lo:253: 20000000:01000000:0.0:1789683235.918076:0:5821:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789683235.918080:0:5821:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789683235.918086:0:5821:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789683235.918094:0:5821:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789683235.918967:0:5821:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683235.919156:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789683235.919169:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789683235.919203:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789683235.919210:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789683235.919236:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789683235.919279:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789683235.919633:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789683235.919649:0:5821:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.160@tcp 20000000:01000000:0.0:1789683235.919651:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:0.0:1789683235.919718:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789683235.919726:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789683235.919770:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789683235.919776:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:0.0:1789683235.919804:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789683235.919811:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789683235.919838:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789683235.919880:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1789683235.920563:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1789683235.920578:0:5821:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.160@tcp 20000000:01000000:0.0:1789683235.920580:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.160@tcp (null) (null) (null) 00000040:00080000:0.0:1789683235.920610:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1789683235.920617:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789683235.920642:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1789683235.920648:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.160@tcp (null) (null) 00000040:00080000:0.0:1789683235.920694:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1789683235.920702:0:5821:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789683235.920742:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1789683235.920773:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1789683235.920787:0:5821:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789683235.920795:0:5821:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789683235.920798:0:5821:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789683235.920809:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789683235.920812:0:5821:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789683235.920842:0:5821:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789683235.920845:0:5821:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789683235.921574:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1789683235.921849:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1789683235.921885:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1789683235.921938:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1789683235.921948:0:5821:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1789683235.921950:0:5821:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789683235.922401:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1789683235.922445:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1789683235.922494:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1789683235.922838:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1789683235.922873:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1789683235.922921:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1789683235.922931:0:5821:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789683235.922934:0:5821:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789683235.923453:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1789683235.923496:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1789683235.923544:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1789683235.923917:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1789683235.923959:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1789683235.923991:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1789683235.924001:0:5821:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789683235.924004:0:5821:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1789683235.924650:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1789683235.924727:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1789683235.924758:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1789683235.924988:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1789683235.925025:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1789683235.925071:0:5821:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1789683235.925084:0:5821:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789683235.925087:0:5821:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789683235.925095:0:5821:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789683235.925113:0:5821:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925131:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe7b3 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925140:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe7dd expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925155:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe807 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925163:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe823 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925170:0:5821:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe84d expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925177:0:5821:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925213:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe84d expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925227:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe84d expref: 16 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683235.925241:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815484672:0@lo:104: 00000100:00100000:0.0:1789683235.925375:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789683235.925471:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe823 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925480:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe823 expref: 16 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683235.925489:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815484800:0@lo:104: 00010000:00010000:0.0:1789683235.925511:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe807 expref: 16 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925531:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe807 expref: 16 pid: 5823 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683235.925540:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815484928:0@lo:104: 00010000:00010000:0.0:1789683235.925565:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe7dd expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925573:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe7dd expref: 16 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683235.925582:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815485056:0@lo:104: 00010000:00010000:0.0:1789683235.925601:0:5821:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe7b3 expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.925609:0:5821:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe7b3 expref: 16 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683235.925617:0:5821:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815485184:0@lo:104: 00000100:00100000:0.0:1789683235.925631:0:5821:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683235.925886:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789683235.925905:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683235.925954:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683235.925998:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683235.926014:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815484672 00000100:00100000:2.0:1789683235.926021:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815484672 00000100:00100000:2.0:1789683235.926051:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815484800 00000100:00100000:2.0:1789683235.926053:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815484800 00000100:00100000:2.0:1789683235.926061:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815484928 00000100:00100000:2.0:1789683235.926063:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815484928 00000100:00100000:2.0:1789683235.926074:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683235.926081:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53efb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+5:5821:x1876618815484672:12345-0@lo:104: 00010000:00010000:2.0:1789683235.926100:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926156:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789683235.926162:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53efb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+5:5821:x1876618815484672:12345-0@lo:104: Request processed in 82us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683235.926170:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683235.926204:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683235.926210:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+4:5821:x1876618815484800:12345-0@lo:104: 00010000:00010000:2.0:1789683235.926218:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926247:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789683235.926251:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+4:5821:x1876618815484800:12345-0@lo:104: Request processed in 43us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683235.926257:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683235.926279:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789683235.926285:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5821:x1876618815484928:12345-0@lo:104: 00010000:00010000:2.0:1789683235.926293:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926326:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789683235.926335:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5821:x1876618815484928:12345-0@lo:104: Request processed in 46us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683235.926340:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1789683235.926359:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789683235.926365:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.926368:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683235.926382:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2c00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683235.926387:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926396:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683235.926404:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683235.926409:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683235.926436:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926443:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683235.926459:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926467:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe84d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe854 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926480:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683235.926483:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926488:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2400 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683235.926492:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926509:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683235.926516:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683235.926521:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683235.926532:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926538:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683235.926544:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926551:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe80e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926563:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683235.926565:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683235.926566:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683235.926577:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815485312:0@lo:103: 00000100:00100000:2.0:1789683235.926605:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683235.926636:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683235.926641:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815485440:0@lo:103: 00010000:00010000:3.0:1789683235.926665:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683235.926667:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683235.926694:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.926704:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d800 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683235.926719:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683235.926727:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815485312 00010000:00010000:3.0:1789683235.926728:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683235.926733:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815485312 10000000:00010000:3.0:1789683235.926741:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683235.926747:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789683235.926753:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe84d expref: 17 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.926765:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.926789:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789683235.926791:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815485440 00000100:00100000:2.0:1789683235.926795:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815485440 00010000:00010000:3.0:1789683235.926804:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926808:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe807 expref: 18 pid: 5823 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.926821:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe823 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe82a expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683235.926830:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683235.926839:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+18:3302:x1876618815485312:12345-0@lo:103: 00010000:00010000:2.0:1789683235.926849:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683235.926856:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe84d expref: 18 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.926857:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683235.926860:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683235.926863:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683235.926871:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe84d expref: 18 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683235.926878:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789683235.926886:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1789683235.926886:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683235.926917:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+18:3302:x1876618815485312:12345-0@lo:103: Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683235.926923:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683235.926938:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683235.926945:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+17:3302:x1876618815485440:12345-0@lo:103: 00010000:00010000:2.0:1789683235.926954:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683235.926958:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe807 expref: 17 pid: 5823 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.926960:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683235.926965:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683235.926972:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe807 expref: 17 pid: 5823 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.926981:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683235.927005:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+17:3302:x1876618815485440:12345-0@lo:103: Request processed in 61us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683235.927011:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683235.927049:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815485440:0@lo:103: 00000100:00100000:2.0:1789683235.927057:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815485312:0@lo:103: 00000100:00100000:0.0:1789683235.927132:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815485568:0@lo:103: 00000100:00100000:0.0:1789683235.927157:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789683235.927199:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fe854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe84d expref: 16 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683235.927209:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef2680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815484672:0@lo:104: 00000100:00100000:0.0:1789683235.927217:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef2a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815484800:0@lo:104: 00010000:00010000:0.0:1789683235.927225:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe80e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe807 expref: 15 pid: 5823 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683235.927239:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815484928:0@lo:104: 00000100:00100000:2.0:1789683235.927276:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815485568 00000100:00100000:2.0:1789683235.927280:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815485568 00010000:00010000:2.0:1789683235.927292:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe823 expref: 15 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683235.927318:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789683235.927324:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+15:3304:x1876618815485568:12345-0@lo:103: 00010000:00010000:2.0:1789683235.927331:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683235.927335:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe823 expref: 15 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.927344:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe823 expref: 15 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.927355:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe44430400/0x59bee33f93fe82a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe823 expref: 15 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683235.927366:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683235.927400:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+14:3304:x1876618815485568:12345-0@lo:103: Request processed in 76us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683235.927406:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683235.927541:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815485568:0@lo:103: 00000100:00100000:1.0:1789683235.927627:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683235.927809:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815485056 00000100:00100000:2.0:1789683235.927813:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815485056 00000100:00100000:2.0:1789683235.927830:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815485184 00000100:00100000:2.0:1789683235.927838:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815485184 00000100:00100000:2.0:1789683235.927854:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683235.927860:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+4:5821:x1876618815485056:12345-0@lo:104: 00010000:00010000:2.0:1789683235.927869:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683235.928004:0:5812:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:1.0:1789683235.928013:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1789683235.928250:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683235.928258:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+4:5821:x1876618815485056:12345-0@lo:104: Request processed in 397us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683235.928271:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683235.928288:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683235.928296:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5821:x1876618815485184:12345-0@lo:104: 00010000:00010000:3.0:1789683235.928315:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928358:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683235.928363:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:5821:x1876618815485184:12345-0@lo:104: Request processed in 69us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683235.928369:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789683235.928384:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683235.928389:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928395:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8de00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683235.928398:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928412:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683235.928418:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683235.928423:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683235.928454:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928461:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683235.928475:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928482:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93fe7dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe7e4 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928493:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683235.928496:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928501:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2600 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683235.928504:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928510:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683235.928516:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683235.928526:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683235.928539:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928545:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683235.928557:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928564:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fe7b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe7ba expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928578:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683235.928580:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683235.928581:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683235.928590:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815485824:0@lo:103: 00000100:00100000:3.0:1789683235.928618:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683235.928664:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815485824 00000100:00100000:3.0:1789683235.928668:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815485824 00010000:00010000:3.0:1789683235.928705:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe7b3 expref: 14 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683235.928725:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683235.928731:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+14:3302:x1876618815485824:12345-0@lo:103: 00010000:00010000:3.0:1789683235.928739:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683235.928743:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe7b3 expref: 14 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928751:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe7b3 expref: 14 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928767:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683235.928792:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+14:3302:x1876618815485824:12345-0@lo:103: Request processed in 61us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683235.928799:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683235.928826:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815485824:0@lo:103: 00000100:00100000:3.0:1789683235.928840:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683235.928846:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815485696:0@lo:103: 00000100:00100000:3.0:1789683235.928866:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683235.928886:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815485696 00000100:00100000:3.0:1789683235.928889:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815485696 00010000:00010000:3.0:1789683235.928901:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe7dd expref: 14 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683235.928918:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683235.928923:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+14:3304:x1876618815485696:12345-0@lo:103: 00010000:00010000:3.0:1789683235.928939:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683235.928944:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe7dd expref: 14 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928952:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe7dd expref: 14 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928963:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928971:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928991:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.928998:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.929004:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.929010:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.929015:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe4583be00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683235.929019:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.929027:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.929035:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.929044:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683235.929069:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+14:3304:x1876618815485696:12345-0@lo:103: Request processed in 145us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683235.929074:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683235.929098:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815485696:0@lo:103: 00010000:00010000:2.0:1789683235.929157:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683235.929289:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe44430200/0x59bee33f93fe7e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe7dd expref: 13 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683235.929324:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815485056:0@lo:104: 00010000:00010000:0.0:1789683235.929350:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe7ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe7b3 expref: 12 pid: 5821 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683235.929359:0:5821:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5821:1876618815485184:0@lo:104: 00010000:00010000:0.0:1789683235.929382:0:5821:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.929390:0:5821:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.929396:0:5821:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683235.929402:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe869 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789683235.929415:0:5821:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789683235.986155:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+11:7621:x1876618815484544:12345-0@lo:253: Request processed in 68103us (68341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683235.986169:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789683235.986365:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815484544:0@lo:253: 10000000:01000000:3.0:1789683235.986384:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789683235.986403:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789683235.986405:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683235.986406:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683235.986407:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:3.0:1789683235.986408:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683235.986410:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683235.986411:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683235.986413:0:7621:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789683235.986415:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683235.986416:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789683235.986440:0:7621:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dbe53b2b800 from lustre-OST0001 10000000:01000000:3.0:1789683235.986480:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789683235.986483:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789683235.986491:0:7621:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dbe48a44d40 local copy 10000000:01000000:3.0:1789683235.986496:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789683235.986535:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.986546:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.986556:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683235.986574:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815485952:0@lo:101: 00000100:00100000:3.0:1789683235.986615:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683235.986731:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe544a4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789683235.986808:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815485952 00000100:00100000:1.0:1789683235.986815:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815485952 00000100:00100000:1.0:1789683235.986895:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789683235.986904:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+11:7621:x1876618815485952:12345-0@lo:101: 00010000:00010000:1.0:1789683235.986917:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683235.986929:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fe877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe870 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683235.986952:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fe877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe870 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683235.986962:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fe877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe870 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683235.986970:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e2200, rc 0) 00000100:00100000:1.0:1789683235.987047:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:7621:x1876618815485952:12345-0@lo:101: Request processed in 144us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683235.987053:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789683235.987121:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815485952:0@lo:101: 00010000:00010000:3.0:1789683235.987133:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.987141:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683235.987230:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486080:0@lo:501: 00000100:00100000:3.0:1789683235.987253:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683235.987392:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe544a4240 going to sleep for 11 seconds 00000100:00100000:1.0:1789683235.987495:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815486080 00000100:00100000:1.0:1789683235.987500:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815486080 00000100:00100000:1.0:1789683235.987528:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789683235.987536:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:7621:x1876618815486080:12345-0@lo:501: 00000100:00100000:1.0:1789683235.987757:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:7621:x1876618815486080:12345-0@lo:501: Request processed in 222us (501us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683235.987764:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683235.987880:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486080:0@lo:501: 10000000:01000000:3.0:1789683235.987892:0:7621:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789683235.987918:0:7621:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789683235.987923:0:7621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.987932:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.987938:0:7621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.987961:0:7621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789683235.987981:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dbe53b2b800 10000000:01000000:3.0:1789683235.987985:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789683235.987990:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789683235.987992:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789683235.987996:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789683235.987999:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789683235.988016:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.988024:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.988043:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683235.988057:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486208:0@lo:101: 00000100:00100000:3.0:1789683235.988084:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683235.988108:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe544a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683235.988119:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815486208 00000100:00100000:3.0:1789683235.988123:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815486208 00000100:00100000:3.0:1789683235.988151:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789683235.988157:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:7621:x1876618815486208:12345-0@lo:101: 00010000:00010000:3.0:1789683235.988165:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683235.988173:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe87e expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.988189:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe87e expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.988197:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe87e expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.988203:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9400, rc 0) 00000100:00100000:3.0:1789683235.988229:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815486208:12345-0@lo:101: Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683235.988234:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789683235.988439:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486208:0@lo:101: 00010000:00010000:3.0:1789683235.988453:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683235.988473:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683235.988529:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486336:0@lo:501: 00000100:00100000:3.0:1789683235.988556:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683235.988579:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe544a4780 going to sleep for 11 seconds 00000100:00100000:2.0:1789683235.988634:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815486336 00000100:00100000:2.0:1789683235.988639:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815486336 00000100:00100000:2.0:1789683235.988669:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683235.988698:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815486336:12345-0@lo:501: 00000100:00100000:2.0:1789683235.988898:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815486336:12345-0@lo:501: Request processed in 201us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683235.988905:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683235.988936:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486336:0@lo:501: 00000100:00100000:2.0:1789683235.988961:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486464:0@lo:503: 00000100:00100000:2.0:1789683235.988996:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683235.989016:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683235.989028:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815486464 00000100:00100000:2.0:1789683235.989031:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815486464 00000100:00100000:2.0:1789683235.989046:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683235.989051:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815486464:12345-0@lo:503: 00000100:00100000:2.0:1789683235.989181:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815486464:12345-0@lo:503: Request processed in 129us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683235.989188:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683235.989223:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486464:0@lo:503: 00000040:00080000:2.0:1789683235.989819:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683235.989888:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486592:0@lo:502: 00000100:00100000:2.0:1789683235.989926:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683235.989950:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3480 going to sleep for 11 seconds 00000100:00100000:3.0:1789683235.990127:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815486592 00000100:00100000:3.0:1789683235.990132:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815486592 00000100:00100000:3.0:1789683235.990166:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683235.990174:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815486592:12345-0@lo:502: 00000100:00100000:3.0:1789683235.990352:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815486592:12345-0@lo:502: Request processed in 178us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683235.990360:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00010000:1.0:1789683235.990376:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683235.990386:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683235.990396:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9600 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:1.0:1789683235.990401:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683235.990411:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683235.990420:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683235.990426:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789683235.990452:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683235.990455:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486592:0@lo:502: 00010000:00010000:1.0:1789683235.990466:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683235.990498:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683235.990506:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9600/0x59bee33f93fe870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x59bee33f93fe877 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683235.990518:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683235.990521:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683235.990530:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683235.990591:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815486720:0@lo:103: 00000100:00100000:0.0:1789683235.990631:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683235.990806:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815486720 00000040:00080000:2.0:1789683235.990808:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000100:00100000:1.0:1789683235.990812:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815486720 00000100:00100000:1.0:1789683235.990852:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683235.990861:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+13:3303:x1876618815486720:12345-0@lo:103: 00000040:00080000:2.0:1789683235.990872:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00010000:00010000:1.0:1789683235.990872:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683235.990891:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fe877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe870 expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683235.990906:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:2.0:1789683235.990926:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000100:00100000:1.0:1789683235.990947:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+12:3303:x1876618815486720:12345-0@lo:103: Request processed in 87us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683235.990955:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683235.990993:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815486720:0@lo:103: 00000040:00080000:2.0:1789683235.990997:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1789683235.991046:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1789683235.991085:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1789683235.991108:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486848:0@lo:502: 00000100:00100000:2.0:1789683235.991145:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683235.991171:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683235.991189:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815486848 00000100:00100000:0.0:1789683235.991195:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815486848 00000100:00100000:0.0:1789683235.991229:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789683235.991238:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:7621:x1876618815486848:12345-0@lo:502: 00000100:00100000:0.0:1789683235.991397:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:7621:x1876618815486848:12345-0@lo:502: Request processed in 159us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683235.991404:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789683235.991424:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486848:0@lo:502: 00000040:00080000:2.0:1789683235.991514:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1789683235.991524:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1789683235.992072:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789683235.992080:0:7631:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789683235.992087:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683235.992090:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789683235.992095:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789683235.992108:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dbe48c60000) 00000020:00000080:2.0:1789683235.992128:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789683235.992133:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789683235.992211:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe53b2b800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789683235.992218:0:7631:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789683235.992223:0:7631:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x59bee33f93fe893 00010000:00010000:3.0:1789683235.995561:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789683235.995875:0:7631:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1789683235.998917:0:7631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1789683235.999240:0:7631:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1789683236.004558:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1789683236.005113:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789683236.006574:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789683236.006587:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683236.006593:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683236.006595:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789683236.006599:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683236.006603:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683236.006604:0:7631:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789683236.006606:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789683236.006609:0:7631:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789683236.006661:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683236.006664:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683236.006666:0:7631:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789683236.006669:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789683236.006881:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1789683236.006907:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789683236.006930:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.006950:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683236.006959:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe53b2b800 from 1 10000000:01000000:2.0:1789683236.006962:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683236.006996:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.007005:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.007016:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683236.007037:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486976:0@lo:101: 00000100:00100000:2.0:1789683236.007099:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.007142:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683236.007188:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815486976 00000100:00100000:3.0:1789683236.007196:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815486976 00000100:00100000:3.0:1789683236.007238:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789683236.007249:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+12:7621:x1876618815486976:12345-0@lo:101: 00010000:00010000:3.0:1789683236.007261:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683236.007273:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe89a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.007315:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe89a expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.007326:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe89a expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.007335:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9e00, rc 0) 00000100:00100000:3.0:1789683236.007373:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815486976:12345-0@lo:101: Request processed in 126us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683236.007380:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789683236.007454:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815486976:0@lo:101: 00010000:00010000:2.0:1789683236.007466:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.007475:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683236.007547:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487104:0@lo:501: 00000100:00100000:2.0:1789683236.007575:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.007587:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683236.007641:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815487104 00000100:00100000:0.0:1789683236.007645:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815487104 00000100:00100000:0.0:1789683236.007703:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789683236.007710:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815487104:12345-0@lo:501: 00000100:00100000:0.0:1789683236.007907:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815487104:12345-0@lo:501: Request processed in 198us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683236.007914:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789683236.008025:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487104:0@lo:501: 00000100:00100000:2.0:1789683236.008057:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487232:0@lo:503: 00000100:00100000:2.0:1789683236.008092:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.008114:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683236.008154:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815487232 00000100:00100000:3.0:1789683236.008158:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815487232 00000100:00100000:3.0:1789683236.008186:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683236.008193:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815487232:12345-0@lo:503: 00000100:00100000:3.0:1789683236.008494:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815487232:12345-0@lo:503: Request processed in 299us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683236.008500:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789683236.008565:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487232:0@lo:503: 00000040:00080000:2.0:1789683236.008849:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683236.008900:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487360:0@lo:502: 00000100:00100000:2.0:1789683236.008933:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.008959:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683236.009134:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815487360 00000100:00100000:3.0:1789683236.009140:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815487360 00000100:00100000:3.0:1789683236.009163:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789683236.009169:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815487360:12345-0@lo:502: 00000100:00100000:3.0:1789683236.009330:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815487360:12345-0@lo:502: Request processed in 160us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683236.009336:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789683236.009415:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487360:0@lo:502: 00000040:00080000:2.0:1789683236.009643:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789683236.009749:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789683236.009773:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487488:0@lo:502: 00000100:00100000:2.0:1789683236.009808:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.009860:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683236.009937:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815487488 00000100:00100000:3.0:1789683236.009942:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815487488 00000100:00100000:3.0:1789683236.010004:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789683236.010017:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815487488:12345-0@lo:502: 00000100:00100000:3.0:1789683236.010131:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815487488:12345-0@lo:502: Request processed in 114us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683236.010138:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789683236.010220:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487488:0@lo:502: 00000040:00080000:2.0:1789683236.010289:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789683236.010309:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789683236.015896:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683236.015932:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683236.015935:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789683236.015942:0:7634:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe53b2b800 00000020:00000080:3.0:1789683236.015945:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789683236.015997:0:7634:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683236.016000:0:7634:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683236.016002:0:7634:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789683236.016005:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789683236.016114:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789683236.016140:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683236.016157:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.016169:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683236.016210:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683236.016218:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dbe53b2b800 10000000:01000000:2.0:1789683236.016221:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dbe53b2b800 10000000:01000000:2.0:1789683236.016225:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683236.016230:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe53b2b800 from 1 10000000:01000000:2.0:1789683236.016233:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683236.016267:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.016276:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.016286:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683236.016317:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487616:0@lo:101: 00000100:00100000:2.0:1789683236.016378:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.016415:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815487616 00000100:00100000:2.0:1789683236.016422:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815487616 00000100:00100000:2.0:1789683236.016458:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789683236.016467:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815487616:12345-0@lo:101: 00010000:00010000:2.0:1789683236.016481:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683236.016492:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe8a8 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.016513:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe8a8 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.016524:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe8a8 expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.016532:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d200, rc 0) 00000100:00100000:2.0:1789683236.016569:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815487616:12345-0@lo:101: Request processed in 102us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.016577:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789683236.016617:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683236.016636:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487616:0@lo:101: 00010000:00010000:2.0:1789683236.016648:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.016657:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683236.016745:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487744:0@lo:501: 00000100:00100000:2.0:1789683236.016768:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.016788:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815487744 00000100:00100000:2.0:1789683236.016792:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815487744 00000100:00100000:2.0:1789683236.016811:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789683236.016817:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815487744:12345-0@lo:501: 00000100:00100000:2.0:1789683236.017001:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815487744:12345-0@lo:501: Request processed in 183us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.017009:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789683236.017032:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683236.017043:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487744:0@lo:501: 00000100:00100000:2.0:1789683236.017065:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487872:0@lo:503: 00000100:00100000:2.0:1789683236.017100:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.017118:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815487872 00000100:00100000:2.0:1789683236.017121:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815487872 00000100:00100000:2.0:1789683236.017139:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789683236.017151:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815487872:12345-0@lo:503: 00000100:00100000:2.0:1789683236.017268:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815487872:12345-0@lo:503: Request processed in 118us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.017275:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789683236.017313:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683236.017325:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815487872:0@lo:503: 00000040:00080000:2.0:1789683236.017539:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683236.017581:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815488000:0@lo:502: 00000100:00100000:2.0:1789683236.017608:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.017626:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815488000 00000100:00100000:2.0:1789683236.017629:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815488000 00000100:00100000:2.0:1789683236.017645:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789683236.017649:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815488000:12345-0@lo:502: 00000100:00100000:2.0:1789683236.017783:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815488000:12345-0@lo:502: Request processed in 133us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.017789:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789683236.017812:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683236.017821:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815488000:0@lo:502: 00000040:00080000:2.0:1789683236.018018:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1789683236.018053:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1789683236.018076:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1789683236.018107:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1789683236.018134:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1789683236.018169:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1789683236.018195:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1789683236.018218:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1789683236.018250:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1789683236.018287:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1789683236.018334:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1789683236.018369:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1789683236.018392:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1789683236.018421:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1789683236.018482:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1789683236.018506:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1789683236.018523:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1789683236.018546:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1789683236.018563:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1789683236.018578:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1789683236.018610:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1789683236.018631:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1789683236.018647:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1789683236.018669:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1789683236.018707:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1789683236.018724:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1789683236.018761:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1789683236.018780:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1789683236.018797:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789683236.018830:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1789683236.018867:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1789683236.018907:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1789683236.018939:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1789683236.018984:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1789683236.019015:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1789683236.019042:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1789683236.019059:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1789683236.019081:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815488128:0@lo:502: 00000100:00100000:2.0:1789683236.019124:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.019149:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815488128 00000100:00100000:2.0:1789683236.019153:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815488128 00000100:00100000:2.0:1789683236.019178:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789683236.019182:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815488128:12345-0@lo:502: 00000100:00100000:3.0:1789683236.019893:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683236.021996:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815488128:12345-0@lo:502: Request processed in 2808us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.022005:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789683236.022089:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815488128:0@lo:502: 00000040:00080000:3.0:1789683236.022200:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1789683236.022213:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789683236.022853:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789683236.022867:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dbe48c64d40) 00000020:00000080:2.0:1789683236.022888:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789683236.022971:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe53b2b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789683236.022976:0:7636:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dbe53b2b800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789683236.022978:0:7636:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe53b2b800 3 00010000:00080000:2.0:1789683236.023003:0:7636:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbd45454800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.160@tcp at head 00010000:00010000:2.0:1789683236.024799:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789683236.024975:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789683236.025006:0:7636:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789683236.025017:0:7636:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x59bee33f93fe8bd 00000100:00080000:2.0:1789683236.025026:0:7636:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789683236.025035:0:7636:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dbd45454800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1789683236.025067:0:7636:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe7bd9a680 x1876618815488256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683236.025121:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876618815488256:0@lo:38: 00000100:00100000:0.0:1789683236.025182:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789683236.025237:0:7636:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789683236.025321:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815488384:0@lo:400: 00000100:00100000:2.0:1789683236.025349:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.025371:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683236.025376:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815488512:0@lo:400: 00000100:00100000:2.0:1789683236.025396:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.025418:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815488640:0@lo:400: 00000100:00100000:2.0:1789683236.025452:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.025483:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815488256 00000100:00100000:2.0:1789683236.025488:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815488256 00000100:00100000:2.0:1789683236.025509:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815488384 00000100:00100000:2.0:1789683236.025512:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815488384 00000100:00100000:2.0:1789683236.025528:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815488512 00000100:00100000:2.0:1789683236.025530:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815488512 00000100:00100000:2.0:1789683236.025542:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789683236.025549:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815488384:12345-0@lo:400: 00000100:00100000:2.0:1789683236.025589:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815488384:12345-0@lo:400: Request processed in 41us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.025595:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789683236.025607:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683236.025612:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815488512:12345-0@lo:400: 00000100:00100000:2.0:1789683236.025634:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815488512:12345-0@lo:400: Request processed in 22us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.025639:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789683236.025649:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683236.025653:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1876618815488256:12345-0@lo:38: 00010000:00080000:2.0:1789683236.025688:0:5830:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1789683236.025728:0:5830:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x59bee33f93fe8c4 00000004:00100000:2.0:1789683236.025744:0:5830:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789683236.025774:0:5830:0:(import.c:65:import_set_state_nolock()) ffff8dbd45455800 : changing import state from RECOVER to FULL 00010000:00080000:0.0:1789683236.027512:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe7bd9a680 x1876618815488256/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683246 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683236.027528:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683236.027537:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1789683236.027544:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789683236.027548:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789683236.027551:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbd45454800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789683236.027556:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876618815488256:0@lo:38: 00000100:00100000:2.0:1789683236.027607:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876618815488256:12345-0@lo:38: Request processed in 1947us (2419us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.027617:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683236.027649:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815488640 00000100:00100000:2.0:1789683236.027750:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815488640 00010000:00080000:3.0:1789683236.027779:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe7bd9b100 x1876618815488512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683236.027793:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815488512:0@lo:400: 00000100:00100000:2.0:1789683236.027795:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683236.027810:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815488640:12345-0@lo:400: 00010000:00080000:3.0:1789683236.027816:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe7bd98700 x1876618815488384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683236.027827:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815488384:0@lo:400: 00000100:00100000:2.0:1789683236.027875:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815488640:12345-0@lo:400: Request processed in 69us (2421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.027882:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789683236.027993:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe7bd9a300 x1876618815488640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683236.028004:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815488640:0@lo:400: 00000040:00080000:3.0:1789683236.028259:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1789683236.028407:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1789683236.028431:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683236.028448:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683236.028458:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789683236.028497:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789683236.028499:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683236.028501:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683236.028502:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683236.028503:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683236.028505:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683236.028506:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683236.028508:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683236.028509:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683236.028510:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683236.028512:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683236.028515:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1789683236.028518:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683236.028519:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683236.028520:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683236.028525:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683236.028526:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683236.028527:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683236.028528:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683236.028529:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683236.028530:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683236.028531:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683236.028532:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683236.028549:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789683236.028561:0:7621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815488768:0@lo:253: 00000100:00100000:2.0:1789683236.028603:0:7621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683236.028632:0:7621:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe497d5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683236.028745:0:7638:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1876618815488896:0@lo:901: 00000100:00100000:0.0:1789683236.028758:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815488768 00000100:00100000:0.0:1789683236.028765:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815488768 00000100:00100000:1.0:1789683236.028782:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683236.028798:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789683236.028803:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae9840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683236.028809:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+14:7621:x1876618815488768:12345-0@lo:253: 20000000:01000000:0.0:1789683236.028832:0:5823:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789683236.028846:0:5823:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1789683236.028915:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815488896 00000100:00100000:2.0:1789683236.028920:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815488896 00000100:00100000:2.0:1789683236.028998:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683236.029006:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1876618815488896:12345-0@lo:901: 00000100:00100000:2.0:1789683236.029383:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1876618815488896:12345-0@lo:901: Request processed in 376us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683236.029390:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789683236.029791:0:7638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe7c524380 x1876618815488896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789683252 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683236.029805:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524380 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1876618815488896:0@lo:901: 00000100:00080000:3.0:1789683236.030515:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:3.0:1789683236.050790:0:5823:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789683236.050803:0:5823:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789683236.050880:0:5845:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789683236.050884:0:5845:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789683236.050999:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683236.051018:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe815 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683236.051084:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683236.051117:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe815 expref: 14 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683236.051128:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe815 expref: 14 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683236.051154:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1876618815489024:0@lo:104: 00000100:00100000:0.0:1789683236.051207:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683236.051245:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683236.051295:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815489024 00000100:00100000:1.0:1789683236.051314:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815489024 00000100:00100000:1.0:1789683236.051365:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789683236.051371:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+3:5845:x1876618815489024:12345-0@lo:104: 00010000:00010000:1.0:1789683236.051382:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683236.051452:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683236.051460:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+3:5845:x1876618815489024:12345-0@lo:104: Request processed in 87us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683236.051467:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683236.051482:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef3b80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5845:1876618815489024:0@lo:104: 00010000:00010000:3.0:1789683236.051500:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683236.051504:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051517:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051525:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8c800 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683236.051529:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051537:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683236.051544:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683236.051550:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683236.051580:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051587:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683236.051606:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051612:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c800/0x59bee33f93fe815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe81c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683236.051622:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815489152:0@lo:103: 00010000:00010000:3.0:1789683236.051627:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683236.051632:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683236.051634:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683236.051649:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683236.051704:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815489152 00000100:00100000:3.0:1789683236.051710:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815489152 00010000:00010000:3.0:1789683236.051727:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe815 expref: 15 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683236.051765:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683236.051772:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+15:3303:x1876618815489152:12345-0@lo:103: 00010000:00010000:3.0:1789683236.051783:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683236.051788:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe815 expref: 15 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051798:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe815 expref: 15 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051811:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe44431e00/0x59bee33f93fe81c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe815 expref: 15 pid: 5822 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051822:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051830:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789683236.051843:0:5815:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002548946s 00010000:00010000:3.0:1789683236.051847:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051853:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051860:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051867:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051883:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe4583be00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683236.051887:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051895:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051908:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683236.051917:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683236.051919:0:5845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683236.051926:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683236.051932:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe8cb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683236.051954:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496c6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+14:3303:x1876618815489152:12345-0@lo:103: Request processed in 182us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683236.051961:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789683236.052096:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815489152:0@lo:103: 00000100:00100000:1.0:1789683236.063040:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:7621:x1876618815488768:12345-0@lo:253: Request processed in 34217us (34419us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683236.063054:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789683236.063181:0:7621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:08ddc492-5684-492d-ac6b-b8fd660301db:7621:1876618815488768:0@lo:253: 10000000:01000000:2.0:1789683236.063207:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789683236.063211:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789683236.063212:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683236.063214:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683236.063215:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683236.063217:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683236.063218:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683236.063219:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683236.063221:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789683236.063222:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789683236.063225:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683236.063226:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789683236.063240:0:7621:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789683236.069056:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789683236.069241:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789683236.069507:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789683236.069828:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789683236.070053:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789683236.070375:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1789683236.072793:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789683236.129744:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1789683236.197218:0:7621:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789683236.197226:0:7621:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789683236.197330:0:7621:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683236.197388:0:7621:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683236.197414:0:7621:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789683236.197608:0:7621:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789683237.151876:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683238.176567:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683239.199928:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683240.224119:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789683240.414117:0:7979:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789683240.416465:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815489280:0@lo:13: 00000100:00100000:0.0:1789683240.416530:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683240.416636:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815489280 00000100:00100000:1.0:1789683240.416644:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815489280 00000100:00100000:1.0:1789683240.416716:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683240.416726:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815489280:12345-0@lo:13: 00002000:00000024:1.0:1789683240.416760:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789683240.421333:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683240.421902:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815489280:12345-0@lo:13: Request processed in 5173us (5366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683240.421915:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1789683240.423041:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c524380 x1876618815489280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683256 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683240.423065:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815489280:0@lo:13: 00010000:00010000:1.0:1789683241.272391:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683241.452424:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815489408:0@lo:400: 00000100:00100000:3.0:1789683241.452495:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683241.452597:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815489536:0@lo:400: 00000100:00100000:3.0:1789683241.452633:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683241.452701:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815489536 00000100:00100000:3.0:1789683241.452708:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815489536 00000100:00100000:3.0:1789683241.452749:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789683241.452757:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815489536:12345-0@lo:400: 00000100:00100000:3.0:1789683241.452823:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815489536:12345-0@lo:400: Request processed in 66us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683241.452830:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789683241.452865:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe48a5dc00 x1876618815489536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683241.452878:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815489536:0@lo:400: 00000100:00100000:3.0:1789683241.452927:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815489664:0@lo:400: 00000100:00100000:3.0:1789683241.452952:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683241.453002:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683241.453009:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815489792:0@lo:400: 00000100:00100000:1.0:1789683241.453029:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815489664 00000100:00100000:1.0:1789683241.453035:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815489664 00000100:00100000:3.0:1789683241.453036:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683241.453075:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815489792 00000100:00100000:1.0:1789683241.453079:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683241.453080:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815489792 00000100:00100000:1.0:1789683241.453089:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815489664:12345-0@lo:400: 00000100:00100000:3.0:1789683241.453115:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683241.453145:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815489664:12345-0@lo:400: Request processed in 47us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683241.453159:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789683241.453879:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683241.454236:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815489792:12345-0@lo:400: 00000100:00100000:3.0:1789683241.454307:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815489792:12345-0@lo:400: Request processed in 79us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683241.454314:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683241.454327:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815489408 00000100:00100000:0.0:1789683241.454333:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815489408 00010000:00080000:3.0:1789683241.454350:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe48a5dc00 x1876618815489664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683241.454369:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789683241.454377:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:3305:x1876618815489408:12345-0@lo:400: 00000100:00100000:0.0:1789683241.454420:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+13:3305:x1876618815489408:12345-0@lo:400: Request processed in 44us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683241.454426:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789683241.455163:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815489664:0@lo:400: 00000100:00100000:0.0:1789683241.456666:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683241.456710:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815489920:0@lo:400: 00000100:00100000:0.0:1789683241.456803:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683241.456905:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815489920 00000100:00100000:3.0:1789683241.456921:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815489920 00000100:00100000:3.0:1789683241.456988:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683241.456997:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815489920:12345-0@lo:400: 00000100:00100000:3.0:1789683241.457049:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815489920:12345-0@lo:400: Request processed in 54us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683241.457055:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789683241.458339:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe48a5dc00 x1876618815489920/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683241.458356:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815489920:0@lo:400: 00000100:00080000:0.0:1789683241.458381:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789683241.458631:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe48a5d180 x1876618815489792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683241.458644:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815489792:0@lo:400: 00000100:00100000:1.0:1789683241.458657:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815489408:0@lo:400: 00010000:00010000:3.0:1789683242.279006:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789683242.465242:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789683242.465249:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe52f3c000 from 30 10000000:01000000:2.0:1789683242.465411:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683242.465519:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.465532:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.465544:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683242.465567:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490048:0@lo:101: 00000100:00100000:2.0:1789683242.465638:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683242.465704:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.465791:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815490048 00000100:00100000:3.0:1789683242.465799:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815490048 00000100:00100000:3.0:1789683242.466026:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789683242.466036:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815490048:12345-0@lo:101: 00010000:00010000:3.0:1789683242.466050:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683242.466062:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe8d2 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.466083:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe8d2 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.466093:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe8d2 expref: 14 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.466102:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9c00, rc 0) 00000100:00100000:3.0:1789683242.466198:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815490048:12345-0@lo:101: Request processed in 163us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.466204:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683242.466531:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490048:0@lo:101: 00010000:00010000:2.0:1789683242.466547:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.466559:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683242.466613:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490176:0@lo:501: 00000100:00100000:2.0:1789683242.466639:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683242.466695:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.468790:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815490176 00000100:00100000:3.0:1789683242.468805:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815490176 00000100:00100000:3.0:1789683242.469173:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789683242.469195:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815490176:12345-0@lo:501: 00000100:00100000:3.0:1789683242.470161:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815490176:12345-0@lo:501: Request processed in 965us (3517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.470171:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683242.475470:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490176:0@lo:501: 00000100:00100000:2.0:1789683242.475581:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490304:0@lo:503: 00000100:00100000:2.0:1789683242.475658:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683242.475775:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683242.479328:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815490304 00000100:00100000:0.0:1789683242.479343:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815490304 00000100:00100000:0.0:1789683242.480240:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789683242.480260:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815490304:12345-0@lo:503: 00000100:00100000:0.0:1789683242.480664:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815490304:12345-0@lo:503: Request processed in 414us (5005us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.480693:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789683242.481283:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490304:0@lo:503: 00000100:00100000:2.0:1789683242.484416:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8084:1876618815490432:0@lo:502: 00000100:00100000:2.0:1789683242.484491:0:8084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683242.484621:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.484662:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815490432 00000100:00100000:3.0:1789683242.484783:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815490432 00000100:00100000:3.0:1789683242.484855:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789683242.484866:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:8084:x1876618815490432:12345-0@lo:502: 00000100:00100000:3.0:1789683242.485168:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:8084:x1876618815490432:12345-0@lo:502: Request processed in 304us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.485175:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789683242.485392:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8084:1876618815490432:0@lo:502: 00000100:00100000:2.0:1789683242.485441:0:8084:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8084:1876618815490560:0@lo:502: 00000100:00100000:2.0:1789683242.485478:0:8084:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683242.485666:0:8084:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.485730:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815490560 00000100:00100000:3.0:1789683242.485734:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815490560 00000100:00100000:3.0:1789683242.485751:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789683242.485757:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:8084:x1876618815490560:12345-0@lo:502: 00000100:00100000:3.0:1789683242.485889:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:8084:x1876618815490560:12345-0@lo:502: Request processed in 132us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.485895:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789683242.486026:0:8084:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8084:1876618815490560:0@lo:502: 00000040:00080000:2.0:1789683242.486044:0:8084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789683242.486463:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789683242.486484:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789683242.486494:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.486558:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683242.486583:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789683242.486586:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1789683242.486588:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789683242.486616:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.486623:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.486632:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683242.486645:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490688:0@lo:101: 00000100:00100000:3.0:1789683242.486716:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.486745:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683242.486801:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815490688 00000100:00100000:2.0:1789683242.486806:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815490688 00000100:00100000:2.0:1789683242.486837:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789683242.486845:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815490688:12345-0@lo:101: 00010000:00010000:2.0:1789683242.486853:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683242.486863:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe8e0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.486884:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe8e0 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.486894:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe8e0 expref: 15 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.486912:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d000, rc 0) 00000100:00100000:2.0:1789683242.486962:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815490688:12345-0@lo:101: Request processed in 118us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683242.486969:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789683242.487128:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490688:0@lo:101: 00010000:00010000:3.0:1789683242.487140:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.487148:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683242.487199:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490816:0@lo:501: 00000100:00100000:3.0:1789683242.487450:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.487474:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e839c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683242.487630:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815490816 00000100:00100000:2.0:1789683242.487634:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815490816 00000100:00100000:2.0:1789683242.487661:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789683242.487668:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815490816:12345-0@lo:501: 00000100:00100000:3.0:1789683242.488351:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815490816:12345-0@lo:501: Request processed in 682us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.488358:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789683242.488465:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490816:0@lo:501: 00000100:00100000:3.0:1789683242.488588:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490944:0@lo:503: 00000100:00100000:3.0:1789683242.488622:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.488700:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e833c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683242.488856:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815490944 00000100:00100000:1.0:1789683242.488861:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815490944 00000100:00100000:1.0:1789683242.488917:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1789683242.488931:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815490944:12345-0@lo:503: 00000100:00100000:1.0:1789683242.489207:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815490944:12345-0@lo:503: Request processed in 284us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683242.489346:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815490944:0@lo:503: 00000100:00100000:1.0:1789683242.489401:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789683242.489950:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8085:1876618815491072:0@lo:502: 00000100:00100000:2.0:1789683242.489986:0:8085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683242.490162:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.490434:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815491072 00000100:00100000:3.0:1789683242.490439:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815491072 00000100:00100000:3.0:1789683242.490467:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683242.490473:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:8085:x1876618815491072:12345-0@lo:502: 00000100:00100000:3.0:1789683242.490768:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:8085:x1876618815491072:12345-0@lo:502: Request processed in 294us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.490775:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789683242.490863:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8085:1876618815491072:0@lo:502: 00000020:01000000:2.0:1789683242.490887:0:8085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683242.490895:0:8085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683242.490898:0:8085:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789683242.490903:0:8085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789683242.490905:0:8085:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789683242.490933:0:8085:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8085:1876618815491200:0@lo:502: 00000100:00100000:2.0:1789683242.490965:0:8085:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683242.490985:0:8085:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.491086:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815491200 00000100:00100000:3.0:1789683242.491091:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815491200 00000100:00100000:3.0:1789683242.491108:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789683242.491114:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:8085:x1876618815491200:12345-0@lo:502: 00000100:00100000:3.0:1789683242.491397:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:8085:x1876618815491200:12345-0@lo:502: Request processed in 283us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.491404:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789683242.491618:0:8085:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8085:1876618815491200:0@lo:502: 00000020:01000000:2.0:1789683242.491636:0:8085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683242.491645:0:8085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683242.491647:0:8085:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789683242.491650:0:8085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:1.0:1789683242.491865:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:1.0:1789683242.491883:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789683242.491893:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683242.491904:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683242.491914:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789683242.491917:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe46fc8800 from 30 10000000:01000000:1.0:1789683242.491920:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683242.491955:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683242.491973:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683242.491983:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683242.491998:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c527b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815491328:0@lo:101: 00000100:00100000:1.0:1789683242.492030:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683242.492062:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.492172:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815491328 00000100:00100000:3.0:1789683242.492178:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815491328 00000100:00100000:3.0:1789683242.492218:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789683242.492226:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815491328:12345-0@lo:101: 00010000:00010000:3.0:1789683242.492237:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683242.492248:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe8ee expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.492278:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe8ee expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.492299:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe8ee expref: 16 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.492307:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8e00, rc 0) 00000100:00100000:3.0:1789683242.492349:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815491328:12345-0@lo:101: Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.492354:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789683242.492493:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c527b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815491328:0@lo:101: 00010000:00010000:2.0:1789683242.492585:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.492594:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683242.492644:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815491456:0@lo:501: 00000100:00100000:2.0:1789683242.492670:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683242.492721:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.492766:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815491456 00000100:00100000:3.0:1789683242.492771:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815491456 00000100:00100000:3.0:1789683242.492788:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789683242.492794:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815491456:12345-0@lo:501: 00000100:00100000:3.0:1789683242.493089:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815491456:12345-0@lo:501: Request processed in 294us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.493096:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789683242.493200:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815491456:0@lo:501: 00000100:00100000:2.0:1789683242.493306:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815491584:0@lo:503: 00000100:00100000:2.0:1789683242.493340:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683242.493361:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.493404:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815491584 00000100:00100000:3.0:1789683242.493408:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815491584 00000100:00100000:3.0:1789683242.493436:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789683242.493442:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815491584:12345-0@lo:503: 00000100:00100000:3.0:1789683242.493669:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815491584:12345-0@lo:503: Request processed in 227us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.493702:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789683242.493820:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815491584:0@lo:503: 00000100:00100000:3.0:1789683242.494285:0:8086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8086:1876618815491712:0@lo:502: 00000100:00100000:3.0:1789683242.494324:0:8086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.494386:0:8086:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e83900 going to sleep for 11 seconds 00000100:00100000:0.0:1789683242.494454:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815491712 00000100:00100000:0.0:1789683242.494459:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815491712 00000100:00100000:1.0:1789683242.494656:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789683242.494664:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+16:8086:x1876618815491712:12345-0@lo:502: 00000100:00100000:1.0:1789683242.494875:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+16:8086:x1876618815491712:12345-0@lo:502: Request processed in 211us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683242.494881:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1789683242.494958:0:8086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8086:1876618815491712:0@lo:502: 00000100:00100000:0.0:1789683242.495000:0:8086:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8086:1876618815491840:0@lo:502: 00000100:00100000:0.0:1789683242.495035:0:8086:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.495359:0:8086:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd4476f240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683242.495420:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815491840 00000100:00100000:3.0:1789683242.495425:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815491840 00000100:00100000:3.0:1789683242.495450:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789683242.495455:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:8086:x1876618815491840:12345-0@lo:502: 00000100:00100000:3.0:1789683242.495735:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:8086:x1876618815491840:12345-0@lo:502: Request processed in 278us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683242.495742:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789683242.495881:0:8086:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8086:1876618815491840:0@lo:502: 00000040:00080000:0.0:1789683242.495902:0:8086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789683242.496494:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789683242.496568:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683242.496578:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.496589:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683242.496600:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789683242.496602:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dbe46fc8800 from 5 10000000:01000000:2.0:1789683242.496612:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683242.496641:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.496649:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683242.496658:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683242.496850:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815491968:0@lo:101: 00000100:00100000:3.0:1789683242.497037:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.497112:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bbf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683242.497154:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815491968 00000100:00100000:0.0:1789683242.497160:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815491968 00000100:00100000:0.0:1789683242.497469:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789683242.497480:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815491968:12345-0@lo:101: 00010000:00010000:0.0:1789683242.497494:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683242.497522:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe4583b400/0x59bee33f93fe903 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe8fc expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683242.497544:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe4583b400/0x59bee33f93fe903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe8fc expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683242.497554:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe4583b400/0x59bee33f93fe903 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe8fc expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683242.497562:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe4583b400, rc 0) 00000100:00100000:0.0:1789683242.497607:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815491968:12345-0@lo:101: Request processed in 129us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.497613:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789683242.497716:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd99f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815491968:0@lo:101: 00010000:00010000:3.0:1789683242.497733:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.497741:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683242.497797:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815492096:0@lo:256: 00000100:00100000:3.0:1789683242.497837:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.498411:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e83900 going to sleep for 11 seconds 00000100:00100000:1.0:1789683242.498482:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815492096 00000100:00100000:1.0:1789683242.498487:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815492096 00000100:00100000:1.0:1789683242.498523:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789683242.498530:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815492096:12345-0@lo:256: 20000000:01000000:1.0:1789683242.498545:0:5822:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789683242.498561:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789683242.498564:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789683242.498787:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815492096:12345-0@lo:256: Request processed in 257us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683242.498794:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789683242.499047:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815492096:0@lo:256: 10000000:01000000:3.0:1789683242.499089:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683242.499096:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.499105:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683242.499113:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789683242.499115:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789683242.499118:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789683242.499143:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.499150:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.499159:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683242.499171:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815492224:0@lo:101: 00000100:00100000:3.0:1789683242.499199:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.499328:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e83900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683242.499360:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815492224 00000100:00100000:2.0:1789683242.499364:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815492224 00000100:00100000:1.0:1789683242.499406:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789683242.499414:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815492224:12345-0@lo:101: 00010000:00010000:1.0:1789683242.499428:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683242.499448:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe90a expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683242.499466:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe90a expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683242.499475:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe90a expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683242.499482:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e2c00, rc 0) 00000100:00100000:1.0:1789683242.499594:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815492224:12345-0@lo:101: Request processed in 180us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683242.499601:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789683242.500042:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815492224:0@lo:101: 00010000:00010000:3.0:1789683242.500056:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683242.500065:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683242.500111:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815492352:0@lo:501: 00000100:00100000:3.0:1789683242.500137:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.500406:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e83900 going to sleep for 11 seconds 00000100:00100000:0.0:1789683242.500473:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815492352 00000100:00100000:0.0:1789683242.500478:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815492352 00000100:00100000:0.0:1789683242.500500:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789683242.500518:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815492352:12345-0@lo:501: 00000100:00100000:0.0:1789683242.500769:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815492352:12345-0@lo:501: Request processed in 252us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.500777:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789683242.500886:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815492352:0@lo:501: 00000100:00100000:3.0:1789683242.500911:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815492480:0@lo:503: 00000100:00100000:3.0:1789683242.500955:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.500980:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e83900 going to sleep for 11 seconds 00000100:00100000:0.0:1789683242.501075:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815492480 00000100:00100000:0.0:1789683242.501080:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815492480 00000100:00100000:0.0:1789683242.501097:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789683242.501102:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815492480:12345-0@lo:503: 00000100:00100000:0.0:1789683242.501401:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815492480:12345-0@lo:503: Request processed in 297us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.501408:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789683242.501543:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815492480:0@lo:503: 00000100:00100000:3.0:1789683242.502035:0:8087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8087:1876618815492608:0@lo:502: 00000100:00100000:3.0:1789683242.502079:0:8087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.502111:0:8087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e833c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683242.502154:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815492608 00000100:00100000:0.0:1789683242.502159:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815492608 00000100:00100000:0.0:1789683242.502181:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789683242.502187:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:8087:x1876618815492608:12345-0@lo:502: 00000100:00100000:0.0:1789683242.502501:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:8087:x1876618815492608:12345-0@lo:502: Request processed in 314us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.502623:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789683242.502708:0:8087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8087:1876618815492608:0@lo:502: 00000020:01000000:3.0:1789683242.502731:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683242.502738:0:8087:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789683242.502744:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683242.502747:0:8087:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789683242.502752:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789683242.502756:0:8087:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:3.0:1789683242.502776:0:8087:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789683242.502779:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683242.502793:0:8087:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dbe484899c0) 00000020:00000080:3.0:1789683242.502811:0:8087:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789683242.502816:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789683242.502893:0:8087:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789683242.502898:0:8087:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789683242.502905:0:8087:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93fe91f 00010000:00080000:3.0:1789683242.503005:0:8087:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbe7bfba800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1789683242.503294:0:8087:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1789683242.503769:0:8087:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789683242.503780:0:8087:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789683242.504619:0:8087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683242.504846:0:8087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683242.504893:0:8087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789683242.504951:0:8087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789683242.505701:0:8088:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789683242.505706:0:8088:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789683242.506316:0:8087:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789683242.506326:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789683242.506356:0:8087:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789683242.506384:0:8087:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93fe926 00000100:00080000:3.0:1789683242.506393:0:8087:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683242.506404:0:8087:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dbe7bfba800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1789683242.506439:0:8087:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe48a5fb80 x1876618815492736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683242.506466:0:8087:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789683242.506730:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815492736:0@lo:8: 00000100:00100000:0.0:1789683242.506795:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.506910:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815492864:0@lo:400: 00000100:00100000:0.0:1789683242.506937:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.506955:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683242.506960:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815492992:0@lo:400: 00000100:00100000:0.0:1789683242.506978:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.507003:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815493120:0@lo:400: 00000100:00100000:0.0:1789683242.507024:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.507038:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683242.507044:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815493248:0@lo:400: 00000100:00100000:0.0:1789683242.507072:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.507100:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815492864 00000100:00100000:0.0:1789683242.507106:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815492864 00000100:00100000:0.0:1789683242.507138:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815492992 00000100:00100000:0.0:1789683242.507141:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815492992 00000100:00100000:0.0:1789683242.507150:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815493248 00000100:00100000:0.0:1789683242.507159:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815493248 00000100:00100000:0.0:1789683242.507176:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683242.507183:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815492864:12345-0@lo:400: 00000100:00100000:0.0:1789683242.507242:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815492864:12345-0@lo:400: Request processed in 59us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.507249:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683242.507274:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683242.507280:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815492992:12345-0@lo:400: 00000100:00100000:0.0:1789683242.507307:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815492992:12345-0@lo:400: Request processed in 27us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.507312:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683242.507322:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683242.507328:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815493248:12345-0@lo:400: 00000100:00100000:0.0:1789683242.507353:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815493248:12345-0@lo:400: Request processed in 26us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.507359:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789683242.507395:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe6fef3100 x1876618815492992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683242.507407:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815492992:0@lo:400: 00010000:00080000:0.0:1789683242.507417:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe6fef2300 x1876618815492864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683242.507425:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815492864:0@lo:400: 00010000:00080000:0.0:1789683242.507451:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe6fef2d80 x1876618815493248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683242.507459:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815493248:0@lo:400: 00000020:01000000:3.0:1789683242.507627:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683242.507633:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683242.507635:0:8087:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789683242.507638:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683242.507642:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683242.507644:0:8087:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789683242.507646:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789683242.507648:0:8087:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789683242.507695:0:8087:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8087:1876618815493376:0@lo:502: 00000100:00100000:3.0:1789683242.507737:0:8087:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.507757:0:8087:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683242.507818:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815493376 00000100:00100000:0.0:1789683242.507823:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815493376 00000100:00100000:0.0:1789683242.507854:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789683242.507861:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:8087:x1876618815493376:12345-0@lo:502: 00000100:00100000:0.0:1789683242.508054:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:8087:x1876618815493376:12345-0@lo:502: Request processed in 193us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.508061:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789683242.508144:0:8087:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8087:1876618815493376:0@lo:502: 00000020:01000000:3.0:1789683242.508164:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683242.508168:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683242.508170:0:8087:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789683242.508173:0:8087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789683242.508363:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789683242.508378:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789683242.508388:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683242.508399:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683242.508410:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789683242.508412:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dbe48a44d40 from 1 10000000:01000000:0.0:1789683242.508415:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789683242.508436:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683242.508443:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683242.508451:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683242.508462:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815493504:0@lo:101: 00000100:00100000:0.0:1789683242.508486:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.508617:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd4476fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683242.508743:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815492736 00000100:00100000:2.0:1789683242.508749:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815492736 00000100:00100000:2.0:1789683242.508775:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815493120 00000100:00100000:2.0:1789683242.508778:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815493120 00000100:00100000:2.0:1789683242.508805:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683242.508812:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815493120:12345-0@lo:400: 00000100:00100000:2.0:1789683242.508853:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815493120:12345-0@lo:400: Request processed in 42us (1828us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683242.508859:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683242.508879:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683242.508883:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876618815492736:12345-0@lo:8: 00010000:00080000:2.0:1789683242.508902:0:6674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 176 last 0 00000020:00000080:2.0:1789683242.508925:0:6674:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93fe934 00002000:00100000:2.0:1789683242.508937:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dbe4e9ee000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1789683242.508940:0:6674:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1789683242.508950:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789683242.509046:0:6674:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789683242.509181:0:6674:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789683242.509202:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9eb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683242.509264:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876618815492736:12345-0@lo:8: Request processed in 379us (2469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683242.509271:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789683242.509288:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683242.509314:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe48a5fb80 x1876618815492736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683242.509323:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789683242.509329:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789683242.509336:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789683242.509341:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1789683242.509343:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bfba800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789683242.509354:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789683242.509359:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815492736:0@lo:8: 00010000:00080000:2.0:1789683242.509386:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe6fef0700 x1876618815493120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683242.509394:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815493120:0@lo:400: 00000100:00100000:1.0:1789683242.512859:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815493504 00000100:00100000:1.0:1789683242.512873:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815493504 00000100:00100000:1.0:1789683242.512957:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789683242.512967:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815493504:12345-0@lo:101: 00010000:00010000:1.0:1789683242.512983:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683242.513002:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe92d expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683242.513028:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe92d expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683242.513039:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe92d expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683242.513049:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e2600, rc 0) 00000100:00100000:1.0:1789683242.513165:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815493504:12345-0@lo:101: Request processed in 200us (4676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683242.513171:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000004:00080000:3.0:1789683242.513812:0:8088:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789683242.514046:0:8088:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 176145372464ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789683242.515749:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815493504:0@lo:101: 00010000:00010000:0.0:1789683242.515774:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683242.515787:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683242.515850:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815493632:0@lo:501: 00000100:00100000:0.0:1789683242.515904:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.515939:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd4476fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683242.516003:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815493632 00000100:00100000:2.0:1789683242.516009:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815493632 00000100:00100000:2.0:1789683242.516050:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789683242.516059:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815493632:12345-0@lo:501: 00000100:00100000:2.0:1789683242.516276:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815493632:12345-0@lo:501: Request processed in 217us (370us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683242.516284:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789683242.516417:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815493632:0@lo:501: 10000000:01000000:0.0:1789683242.516437:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789683242.516444:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683242.516453:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683242.559128:0:8089:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789683242.559157:0:8089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1876618815493888:0@lo:7: 00000100:00100000:0.0:1789683242.559318:0:8089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.559372:0:8089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53125d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683242.559390:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683242.559400:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815493760:0@lo:13: 00000100:00100000:0.0:1789683242.559423:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.559450:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815493760 00000100:00100000:0.0:1789683242.559456:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815493760 00000100:00100000:0.0:1789683242.559508:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683242.559516:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815493760:12345-0@lo:13: 00002000:00000024:0.0:1789683242.559545:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789683242.559581:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815493760:12345-0@lo:13: Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.559587:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789683242.559620:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6ab100 x1876618815493760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683242.559636:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815493760:0@lo:13: 00000100:00080000:0.0:1789683242.561440:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683242.561462:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815493888 00000100:00100000:0.0:1789683242.561471:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815493888 00000100:00100000:0.0:1789683242.561528:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683242.561538:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8089:x1876618815493888:12345-0@lo:7: 00002000:00080000:0.0:1789683242.569917:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1789683242.569925:0:6674:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1789683242.570005:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8089:x1876618815493888:12345-0@lo:7: Request processed in 8466us (10683us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.570014:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789683242.570156:0:8089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6aa300 x1876618815493888/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789683258 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683242.570170:0:8089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1876618815493888:0@lo:7: 00000004:00080000:3.0:1789683242.570183:0:8089:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1789683242.570237:0:8089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1876618815494016:0@lo:5: 00000100:00100000:3.0:1789683242.570278:0:8089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683242.570322:0:8089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683242.570553:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815494016 00000100:00100000:0.0:1789683242.570560:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815494016 00000100:00100000:0.0:1789683242.570604:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683242.570613:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8089:x1876618815494016:12345-0@lo:5: 00002000:00080000:0.0:1789683242.570636:0:6676:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1789683242.570639:0:6676:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1789683242.570871:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8089:x1876618815494016:12345-0@lo:5: Request processed in 258us (591us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789683242.570877:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789683242.570913:0:8089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe48a5c000 x1876618815494016/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683258 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683242.570925:0:8089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1876618815494016:0@lo:5: 00000004:00080000:0.0:1789683242.570933:0:8089:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1789683242.570956:0:8089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1876618815494144:0@lo:700: 00000100:00100000:0.0:1789683242.570979:0:8089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.571000:0:8089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53125e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683242.572546:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815494144 00000100:00100000:1.0:1789683242.572559:0:6683:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815494144 00000100:00100000:1.0:1789683242.572606:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683242.572616:0:6683:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8089:x1876618815494144:12345-0@lo:700: 00000100:00100000:1.0:1789683242.572666:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6683:1876618815494272:0@lo:700: 00000100:00100000:1.0:1789683242.572732:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683242.572756:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683242.572773:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815494272 00000100:00100000:1.0:1789683242.572777:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815494272 00000100:00100000:1.0:1789683242.572804:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683242.572810:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6683:x1876618815494272:12345-0@lo:700: 00000004:00080000:2.0:1789683242.597237:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:1.0:1789683242.630933:0:5836:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1789683242.637380:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6683:x1876618815494272:12345-0@lo:700: Request processed in 64565us (64641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683242.637394:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789683242.637568:0:6683:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c525880 x1876618815494272/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789683258 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683242.637583:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6683:1876618815494272:0@lo:700: 40000000:02000000:1.0:1789683242.637597:0:6683:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1789683242.794876:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789683242.794893:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789683242.795025:0:6683:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8089:x1876618815494144:12345-0@lo:700: Request processed in 222408us (224041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683242.795036:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789683242.795134:0:8089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6ab100 x1876618815494144/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789683258 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683242.795145:0:8089:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789683242.795160:0:8089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1876618815494144:0@lo:700: 00000004:02000040:1.0:1789683242.837067:0:8089:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789683242.853973:0:8089:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1876618815494400:0@lo:5: 00000100:00100000:0.0:1789683242.854039:0:8089:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683242.854106:0:8089:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae9600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683242.854529:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815494400 00000100:00100000:2.0:1789683242.854537:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815494400 00000100:00100000:2.0:1789683242.854594:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683242.854604:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8089:x1876618815494400:12345-0@lo:5: 00002000:00080000:3.0:1789683242.866021:0:6674:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789683242.866044:0:6674:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789683242.876425:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8089:x1876618815494400:12345-0@lo:5: Request processed in 21815us (22378us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789683242.876438:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1789683242.876787:0:8089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6a8e00 x1876618815494400/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789683258 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683242.876807:0:8089:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1876618815494400:0@lo:5: 00000004:00080000:0.0:1789683242.876823:0:8089:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1789683243.295863:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683244.320924:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683245.345543:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683245.535820:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815494528:0@lo:13: 00000100:00100000:0.0:1789683245.535895:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683245.535975:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815494528 00000100:00100000:0.0:1789683245.535982:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815494528 00000100:00100000:0.0:1789683245.536029:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683245.536037:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815494528:12345-0@lo:13: 00002000:00000024:0.0:1789683245.536070:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683245.536110:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815494528:12345-0@lo:13: Request processed in 74us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683245.536126:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789683245.536146:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683245.536176:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6a8380 x1876618815494528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683245.536204:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815494528:0@lo:13: 00000001:00080000:3.0:1789683246.301721:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789683246.384244:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683247.394422:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683247.584192:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815494784:0@lo:400: 00000100:00100000:1.0:1789683247.584274:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683247.584326:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815495296:0@lo:400: 00000100:00100000:1.0:1789683247.584350:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683247.584373:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789683247.584378:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815494656:0@lo:13: 00000100:00100000:1.0:1789683247.584400:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683247.584417:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815495168:0@lo:400: 00000100:00100000:1.0:1789683247.584437:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683247.584461:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815495040:0@lo:400: 00000100:00100000:1.0:1789683247.584485:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683247.584502:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789683247.584506:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815494912:0@lo:400: 00000100:00100000:1.0:1789683247.584542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683247.584561:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815495424:0@lo:400: 00000100:00100000:1.0:1789683247.584579:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683247.584605:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815494784 00000100:00100000:1.0:1789683247.584612:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815494784 00000100:00100000:1.0:1789683247.584653:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789683247.584661:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815494784:12345-0@lo:400: 00000100:00100000:1.0:1789683247.584976:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815494784:12345-0@lo:400: Request processed in 315us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683247.584985:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789683247.585016:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815495296 00000100:00100000:1.0:1789683247.585026:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815495296 00000100:00100000:1.0:1789683247.585060:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815495040 00000100:00100000:1.0:1789683247.585062:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815495040 00000100:00100000:1.0:1789683247.585073:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815494912 00000100:00100000:1.0:1789683247.585076:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815494912 00000100:00100000:1.0:1789683247.585088:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683247.585093:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815495296:12345-0@lo:400: 00000100:00100000:1.0:1789683247.585125:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815495296:12345-0@lo:400: Request processed in 32us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683247.585130:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683247.585141:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683247.585147:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815495040:12345-0@lo:400: 00000100:00100000:0.0:1789683247.585333:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815494784:0@lo:400: 00010000:00080000:0.0:1789683247.585348:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c525500 x1876618815495296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683247.585359:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815495296:0@lo:400: 00000100:00100000:1.0:1789683247.585528:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815495040:12345-0@lo:400: Request processed in 381us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683247.585535:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683247.585548:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683247.585554:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815494912:12345-0@lo:400: 00000100:00100000:1.0:1789683247.585581:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815494912:12345-0@lo:400: Request processed in 28us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683247.585587:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683247.585605:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815494656 00000100:00100000:1.0:1789683247.585609:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815494656 00000100:00100000:1.0:1789683247.585635:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683247.585641:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815494656:12345-0@lo:13: 00002000:00000024:1.0:1789683247.585706:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683247.585740:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815494656:12345-0@lo:13: Request processed in 99us (1338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683247.585745:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683247.585783:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815495168 00000100:00100000:1.0:1789683247.585786:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815495168 00000100:00100000:1.0:1789683247.585809:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815495424 00000100:00100000:1.0:1789683247.585811:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815495424 00000100:00100000:1.0:1789683247.585822:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683247.585827:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815495168:12345-0@lo:400: 00000100:00100000:1.0:1789683247.585855:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815495168:12345-0@lo:400: Request processed in 28us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683247.585860:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683247.585869:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683247.585874:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815495424:12345-0@lo:400: 00000100:00100000:1.0:1789683247.585896:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815495424:12345-0@lo:400: Request processed in 22us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683247.585901:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789683247.585926:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683247.585930:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683247.585933:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789683247.585957:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6a8380 x1876618815494656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683263 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683247.585966:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789683247.585980:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815494656:0@lo:13: 00010000:00080000:1.0:1789683247.585991:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c524a80 x1876618815495168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683247.586000:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815495168:0@lo:400: 00010000:00080000:0.0:1789683247.601635:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c526a00 x1876618815495040/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683247.601670:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815495040:0@lo:400: 00010000:00080000:0.0:1789683247.601718:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c524700 x1876618815494912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683247.601727:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815494912:0@lo:400: 00010000:00080000:0.0:1789683247.601739:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c526680 x1876618815495424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683247.601747:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815495424:0@lo:400: 00000100:00100000:1.0:1789683247.972492:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683247.974657:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802889088 00000100:00100000:0.0:1789683247.974671:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802889088 00000100:00100000:0.0:1789683247.974761:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:0.0:1789683247.974770:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2351:x1876618802889088:12345-192.168.203.60@tcp:250: 00010000:00080000:0.0:1789683247.974797:0:5823:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 85ca73fa-7ddf-4820-b817-0961de675c61@192.168.203.60@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:0.0:1789683247.974838:0:5823:0:(genops.c:1384:class_connect()) connect: client 85ca73fa-7ddf-4820-b817-0961de675c61, cookie 0x59bee33f93fe942 00000100:00080000:0.0:1789683247.974995:0:5823:0:(import.c:65:import_set_state_nolock()) ffff8dbd44c98800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683247.975083:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+5:2351:x1876618802889088:12345-192.168.203.60@tcp:250: Request processed in 313us (2600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683247.975091:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:0.0:1789683247.978760:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683247.979572:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802888960 00000100:00100000:1.0:1789683247.979593:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802888960 00000100:00100000:1.0:1789683247.979668:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1789683247.979700:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+5:5574:x1876618802888960:12345-192.168.203.60@tcp:101: 00010000:00010000:1.0:1789683247.979717:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683247.979736:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449efebc expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683247.979762:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efebc expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683247.979772:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efebc expref: 6 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683247.979781:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e3200, rc 0) 00000100:00100000:1.0:1789683247.979841:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+6:5574:x1876618802888960:12345-192.168.203.60@tcp:101: Request processed in 144us (1089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683247.979849:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:3.0:1789683247.981990:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683247.993657:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802889216 00000100:00100000:2.0:1789683247.993695:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802889216 00000100:00100000:2.0:1789683247.993753:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:2.0:1789683247.993769:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+6:5574:x1876618802889216:12345-192.168.203.60@tcp:501: 00000100:00100000:2.0:1789683247.998560:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+6:5574:x1876618802889216:12345-192.168.203.60@tcp:501: Request processed in 4787us (16565us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683247.998575:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:3.0:1789683248.000707:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683248.004716:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802889344 00000100:00100000:0.0:1789683248.004729:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802889344 00000100:00100000:0.0:1789683248.004804:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:0.0:1789683248.004815:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+6:5574:x1876618802889344:12345-192.168.203.60@tcp:101: 00010000:00010000:0.0:1789683248.004831:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683248.004848:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449efec3 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683248.004876:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efec3 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683248.004886:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efec3 expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683248.004895:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe4583b000, rc 0) 00000100:00100000:0.0:1789683248.004963:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+7:5574:x1876618802889344:12345-192.168.203.60@tcp:101: Request processed in 149us (4299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683248.004971:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:0.0:1789683248.011451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683248.016526:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802889472 00000100:00100000:2.0:1789683248.016541:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802889472 00000100:00100000:2.0:1789683248.016609:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:2.0:1789683248.016619:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+7:5574:x1876618802889472:12345-192.168.203.60@tcp:501: 00000100:00100000:2.0:1789683248.016966:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+8:5574:x1876618802889472:12345-192.168.203.60@tcp:501: Request processed in 347us (5524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683248.016973:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:3.0:1789683248.025791:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683248.025899:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802889600 00000100:00100000:1.0:1789683248.025909:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802889600 00000100:00100000:1.0:1789683248.025967:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:1.0:1789683248.025977:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+8:5574:x1876618802889600:12345-192.168.203.60@tcp:503: 00000100:00100000:1.0:1789683248.026358:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+8:5574:x1876618802889600:12345-192.168.203.60@tcp:503: Request processed in 381us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683248.026367:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:3.0:1789683248.049417:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683248.049621:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802889728 00000100:00100000:0.0:1789683248.049632:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802889728 00000100:00100000:0.0:1789683248.049712:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:0.0:1789683248.049735:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+8:5593:x1876618802889728:12345-192.168.203.60@tcp:502: 00000100:00100000:0.0:1789683248.050069:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+8:5593:x1876618802889728:12345-192.168.203.60@tcp:502: Request processed in 335us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683248.050078:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:0.0:1789683248.143880:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683248.144430:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802889856 00000100:00100000:2.0:1789683248.144440:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802889856 00000100:00100000:2.0:1789683248.144487:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1789683248.144497:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+8:5593:x1876618802889856:12345-192.168.203.60@tcp:502: 00000100:00100000:2.0:1789683248.144898:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+8:5593:x1876618802889856:12345-192.168.203.60@tcp:502: Request processed in 393us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683248.144913:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1789683248.164367:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683248.164475:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802889984 00000100:00100000:1.0:1789683248.164486:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802889984 00000100:00100000:1.0:1789683248.164536:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:1.0:1789683248.164546:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+8:5574:x1876618802889984:12345-192.168.203.60@tcp:101: 00010000:00010000:1.0:1789683248.164585:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683248.164604:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe820e3800/0x59bee33f93fe957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449efeed expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683248.164632:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e3800/0x59bee33f93fe957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efeed expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683248.164645:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe820e3800/0x59bee33f93fe957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efeed expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683248.164654:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e3800, rc 0) 00000100:00100000:1.0:1789683248.164721:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+9:5574:x1876618802889984:12345-192.168.203.60@tcp:101: Request processed in 177us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683248.164728:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:3.0:1789683248.170065:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683248.170223:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802890112 00000100:00100000:0.0:1789683248.170234:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802890112 00000100:00100000:0.0:1789683248.170291:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:0.0:1789683248.170301:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+9:5574:x1876618802890112:12345-192.168.203.60@tcp:256: 20000000:01000000:0.0:1789683248.170326:0:5823:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789683248.170351:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789683248.170354:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789683248.170357:0:5823:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789683248.170359:0:5823:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789683248.191583:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+9:5574:x1876618802890112:12345-192.168.203.60@tcp:256: Request processed in 17173us (17417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683248.191606:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:2.0:1789683248.205922:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683248.206031:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802890240 00000100:00100000:1.0:1789683248.206041:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802890240 00000100:00100000:1.0:1789683248.206092:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:1.0:1789683248.206102:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+9:5574:x1876618802890240:12345-192.168.203.60@tcp:101: 00010000:00010000:1.0:1789683248.206118:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683248.206135:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449efef4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683248.206160:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efef4 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683248.206181:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efef4 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683248.206189:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e3600, rc 0) 00000100:00100000:1.0:1789683248.206266:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:5574:x1876618802890240:12345-192.168.203.60@tcp:101: Request processed in 165us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683248.206273:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:3.0:1789683248.209232:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683248.216190:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802890368 00000100:00100000:0.0:1789683248.216205:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802890368 00000100:00100000:0.0:1789683248.216274:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:0.0:1789683248.216284:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:5574:x1876618802890368:12345-192.168.203.60@tcp:501: 00000100:00100000:0.0:1789683248.217622:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:5574:x1876618802890368:12345-192.168.203.60@tcp:501: Request processed in 1333us (8393us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683248.217632:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:0.0:1789683248.220854:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683248.221121:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802890496 00000100:00100000:2.0:1789683248.221131:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802890496 00000100:00100000:2.0:1789683248.221189:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:2.0:1789683248.221199:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:5574:x1876618802890496:12345-192.168.203.60@tcp:503: 00000100:00100000:2.0:1789683248.222180:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:5574:x1876618802890496:12345-192.168.203.60@tcp:503: Request processed in 977us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683248.222191:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:3.0:1789683248.226752:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683248.226783:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802890624 00000100:00100000:3.0:1789683248.226792:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802890624 00000100:00100000:3.0:1789683248.229150:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:3.0:1789683248.229178:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:5598:x1876618802890624:12345-192.168.203.60@tcp:502: 00000100:00100000:3.0:1789683248.229497:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:5598:x1876618802890624:12345-192.168.203.60@tcp:502: Request processed in 322us (2739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683248.229506:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:3.0:1789683248.240258:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683248.240367:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802890752 00000100:00100000:1.0:1789683248.240388:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802890752 00000100:00100000:1.0:1789683248.240440:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:1.0:1789683248.240449:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:5598:x1876618802890752:12345-192.168.203.60@tcp:502: 00000100:00100000:1.0:1789683248.240707:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:5598:x1876618802890752:12345-192.168.203.60@tcp:502: Request processed in 224us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683248.240715:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:0.0:1789683248.245580:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683248.246369:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802890880 00000100:00100000:1.0:1789683248.246390:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802890880 00000100:00100000:1.0:1789683248.246442:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1789683248.246450:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1876618802890880:12345-192.168.203.60@tcp:38: 00010000:00080000:1.0:1789683248.246477:0:6698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp t0 exp 0000000000000000 cur 181 last 0 00000020:00000080:1.0:1789683248.246535:0:6698:0:(genops.c:1384:class_connect()) connect: client 54d6ac2c-8152-4eed-adb8-5b5d9e80a202, cookie 0x59bee33f93fe965 00000004:00100000:1.0:1789683248.246564:0:6698:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789683248.246570:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1789683248.338389:0:6698:0:(import.c:65:import_set_state_nolock()) ffff8dbd44c8a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683248.338466:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2351:x1876618802890880:12345-192.168.203.60@tcp:38: Request processed in 92014us (92893us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683248.338476:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00010000:00010000:3.0:1789683248.415913:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683249.399505:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683249.399551:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683249.399729:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802891136 00000100:00100000:3.0:1789683249.399739:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802891136 00000100:00100000:3.0:1789683249.399818:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802891008 00000100:00100000:3.0:1789683249.399822:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802891008 00000100:00100000:3.0:1789683249.399844:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1789683249.399854:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:5574:x1876618802891136:12345-192.168.203.60@tcp:41: 00000004:00000024:3.0:1789683249.399897:0:5829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789683249.399995:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:5574:x1876618802891136:12345-192.168.203.60@tcp:41: Request processed in 142us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683249.400002:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1789683249.400020:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1789683249.400026:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:0:x1876618802891008:12345-192.168.203.60@tcp:41: 00000004:00000024:3.0:1789683249.400037:0:5829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789683249.400056:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:0:x1876618802891008:12345-192.168.203.60@tcp:41: Request processed in 30us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683249.400062:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00080000:2.0:1789683249.401010:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683249.403207:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683249.403369:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802891264 00000100:00100000:1.0:1789683249.403379:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802891264 00000100:00100000:1.0:1789683249.403429:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1789683249.403439:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:5574:x1876618802891264:12345-192.168.203.60@tcp:40: 00000100:00100000:1.0:1789683249.403552:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:5574:x1876618802891264:12345-192.168.203.60@tcp:40: Request processed in 114us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683249.403560:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1789683249.410596:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683249.410819:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802891648 00000100:00100000:1.0:1789683249.410829:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802891648 00000100:00100000:1.0:1789683249.410880:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1789683249.410890:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:5574:x1876618802891648:12345-192.168.203.60@tcp:33: 00000100:00100000:3.0:1789683249.419714:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683249.419744:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683249.419767:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683249.419855:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802891392 00000100:00100000:2.0:1789683249.419865:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802891392 00000100:00100000:2.0:1789683249.419920:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802891520 00000100:00100000:2.0:1789683249.419923:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802891520 00000100:00100000:2.0:1789683249.419936:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1789683249.419944:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876618802891392:12345-192.168.203.60@tcp:8: 00010000:00080000:2.0:1789683249.419972:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1789683249.420001:0:6676:0:(genops.c:1384:class_connect()) connect: client 54d6ac2c-8152-4eed-adb8-5b5d9e80a202, cookie 0x59bee33f93fe96c 00002000:00100000:2.0:1789683249.420015:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 54d6ac2c-8152-4eed-adb8-5b5d9e80a202/ffff8dbe4e9eb800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789683249.420050:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789683249.420379:0:6676:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789683249.420407:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9ea000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683249.420471:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2351:x1876618802891392:12345-192.168.203.60@tcp:8: Request processed in 525us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683249.420478:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1789683249.420497:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1789683249.420502:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876618802891520:12345-192.168.203.60@tcp:8: 00010000:00080000:2.0:1789683249.420518:0:6676:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:2.0:1789683249.420534:0:6676:0:(genops.c:1384:class_connect()) connect: client 54d6ac2c-8152-4eed-adb8-5b5d9e80a202, cookie 0x59bee33f93fe973 00002000:00100000:2.0:1789683249.420540:0:6676:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 54d6ac2c-8152-4eed-adb8-5b5d9e80a202/ffff8dbe4e9ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789683249.420553:0:6676:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789683249.420785:0:6676:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789683249.420801:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9ec000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683249.420826:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2351:x1876618802891520:12345-192.168.203.60@tcp:8: Request processed in 322us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683249.420833:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1789683249.425620:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802891776 00000100:00100000:1.0:1789683249.425634:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802891776 00000100:00100000:1.0:1789683249.425708:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:1.0:1789683249.425719:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2352:x1876618802891776:12345-192.168.203.60@tcp:400: 00000100:00100000:1.0:1789683249.425796:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2352:x1876618802891776:12345-192.168.203.60@tcp:400: Request processed in 78us (6128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683249.430193:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 126 00010000:00010000:2.0:1789683249.482285:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789683249.487330:0:5832:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 76366us 00000004:00200000:3.0:1789683249.550815:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789683249.550932:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:5574:x1876618802891648:12345-192.168.203.60@tcp:33: Request processed in 140038us (140340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683249.550947:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1789683249.936084:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683249.936352:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802891904 00000100:00100000:3.0:1789683249.936367:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802891904 00000100:00100000:3.0:1789683249.936441:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1789683249.936584:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:5615:x1876618802891904:12345-192.168.203.60@tcp:101: 00010000:00010000:3.0:1789683249.936615:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683249.951183:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fe97a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449eff1e expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683249.951571:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fe981 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683249.951586:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fe981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683249.951615:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fe981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683249.951658:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789683249.951662:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683249.951706:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fe981 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683249.951739:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fe97a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff1e expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683249.951764:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fe981 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff1e expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683249.951773:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931ed00) 00010000:00010000:3.0:1789683249.951776:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683249.951791:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8a00, rc 0) 00000100:00100000:2.0:1789683249.951986:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:5615:x1876618802891904:12345-192.168.203.60@tcp:101: Request processed in 15524us (15906us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683249.952000:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:3.0:1789683250.527989:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683250.657232:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815495552:0@lo:13: 00000100:00100000:1.0:1789683250.657334:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683250.657507:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815495552 00000100:00100000:0.0:1789683250.657519:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815495552 00000100:00100000:0.0:1789683250.657594:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683250.657605:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815495552:12345-0@lo:13: 00002000:00000024:0.0:1789683250.657650:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683250.657724:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815495552:12345-0@lo:13: Request processed in 121us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683250.657731:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1789683250.657840:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789683250.659986:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6aa680 x1876618815495552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683266 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683250.660020:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815495552:0@lo:13: 00010000:00010000:3.0:1789683251.551910:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683252.580282:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683252.604137:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683252.604314:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802892032 00000100:00100000:1.0:1789683252.604328:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802892032 00000100:00100000:1.0:1789683252.604420:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1789683252.604434:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:5667:x1876618802892032:12345-192.168.203.60@tcp:41: 00000004:00000024:1.0:1789683252.604492:0:5829:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1789683252.604585:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:5667:x1876618802892032:12345-192.168.203.60@tcp:41: Request processed in 155us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683252.604593:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:2.0:1789683252.604713:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683252.608207:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683252.608344:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802892160 00000100:00100000:0.0:1789683252.608354:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802892160 00000100:00100000:0.0:1789683252.608429:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1789683252.608440:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:5667:x1876618802892160:12345-192.168.203.60@tcp:13: 00002000:00000024:0.0:1789683252.608476:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683252.608552:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:5667:x1876618802892160:12345-192.168.203.60@tcp:13: Request processed in 113us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683252.608559:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00080000:2.0:1789683252.608631:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683252.610974:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683252.611233:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802892288 00000100:00100000:1.0:1789683252.611255:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802892288 00000100:00100000:1.0:1789683252.611364:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1789683252.611375:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:5667:x1876618802892288:12345-192.168.203.60@tcp:13: 00002000:00000024:1.0:1789683252.611411:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683252.611469:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:5667:x1876618802892288:12345-192.168.203.60@tcp:13: Request processed in 96us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683252.611477:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:2.0:1789683252.618024:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683252.704015:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815495808:0@lo:400: 00000100:00100000:1.0:1789683252.704079:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683252.704148:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815496320:0@lo:400: 00000100:00100000:1.0:1789683252.704173:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683252.704210:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789683252.704216:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815495680:0@lo:400: 00000100:00100000:1.0:1789683252.704244:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683252.704263:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815496192:0@lo:400: 00000100:00100000:1.0:1789683252.704282:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683252.704308:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815495808 00000100:00100000:1.0:1789683252.704316:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815495808 00000100:00100000:1.0:1789683252.704354:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815496192 00000100:00100000:1.0:1789683252.704358:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815496192 00000100:00100000:1.0:1789683252.704381:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683252.704389:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815495808:12345-0@lo:400: 00000100:00100000:1.0:1789683252.704436:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815495808:12345-0@lo:400: Request processed in 48us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683252.704443:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683252.704458:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683252.704464:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815496192:12345-0@lo:400: 00000100:00100000:1.0:1789683252.704505:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815496192:12345-0@lo:400: Request processed in 41us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683252.704511:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683252.704529:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815495936:0@lo:400: 00000100:00100000:1.0:1789683252.704551:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683252.704568:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683252.704574:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815496064:0@lo:400: 00000100:00100000:1.0:1789683252.704593:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683252.704618:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815496320 00000100:00100000:1.0:1789683252.704621:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815496320 00000100:00100000:1.0:1789683252.704644:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815496064 00000100:00100000:1.0:1789683252.704647:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815496064 00000100:00100000:1.0:1789683252.704661:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683252.704668:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815496320:12345-0@lo:400: 00000100:00100000:1.0:1789683252.704718:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815496320:12345-0@lo:400: Request processed in 51us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683252.704724:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683252.704735:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683252.704740:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815496064:12345-0@lo:400: 00000100:00100000:1.0:1789683252.704768:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815496064:12345-0@lo:400: Request processed in 28us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683252.704773:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789683252.704803:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76a18000 x1876618815496064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683252.704815:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815496064:0@lo:400: 00000100:00100000:1.0:1789683252.704834:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815495936 00000100:00100000:1.0:1789683252.704842:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815495936 00000100:00100000:1.0:1789683252.704858:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683252.704863:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815495936:12345-0@lo:400: 00000100:00100000:1.0:1789683252.704892:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815495936:12345-0@lo:400: Request processed in 28us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683252.704897:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683252.704919:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815495936:0@lo:400: 00000100:00100000:1.0:1789683252.704935:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815496192:0@lo:400: 00000100:00100000:1.0:1789683252.704943:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815495808:0@lo:400: 00010000:00080000:1.0:1789683252.704952:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76a1b800 x1876618815496320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683252.704961:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815496320:0@lo:400: 00000100:00100000:1.0:1789683252.705313:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815496448:0@lo:13: 00000100:00100000:1.0:1789683252.705342:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789683252.705428:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683252.705432:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683252.705435:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683252.705808:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815495680 00000100:00100000:3.0:1789683252.705814:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815495680 00000100:00100000:3.0:1789683252.705842:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789683252.705848:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815495680:12345-0@lo:400: 00000100:00100000:3.0:1789683252.705899:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815495680:12345-0@lo:400: Request processed in 40us (1643us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683252.705905:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789683252.705949:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815495680:0@lo:400: 00000100:00100000:0.0:1789683252.710188:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815496448 00000100:00100000:0.0:1789683252.710202:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815496448 00000100:00100000:0.0:1789683252.710253:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683252.710262:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815496448:12345-0@lo:13: 00002000:00000024:0.0:1789683252.710285:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683252.710355:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815496448:12345-0@lo:13: Request processed in 94us (5012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683252.710361:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789683252.710411:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6a8a80 x1876618815496448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683268 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683252.710430:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815496448:0@lo:13: 00000001:00100000:0.0:1789683252.824827:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000001:00100000:1.0:1789683252.850028:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00010000:00010000:1.0:1789683253.602228:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789683253.783523:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000100:00100000:2.0:1789683254.440129:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683254.440226:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683254.440265:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683254.440307:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683254.440340:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802892672 00000100:00100000:2.0:1789683254.440352:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802892672 00000100:00100000:2.0:1789683254.440414:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802892800 00000100:00100000:2.0:1789683254.440417:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802892800 00000100:00100000:2.0:1789683254.440435:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1789683254.440446:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802892672:12345-192.168.203.60@tcp:400: 00000100:00100000:2.0:1789683254.440533:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802892672:12345-192.168.203.60@tcp:400: Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683254.440559:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1789683254.440577:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:2.0:1789683254.440583:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802892800:12345-192.168.203.60@tcp:400: 00000100:00100000:2.0:1789683254.440605:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802892800:12345-192.168.203.60@tcp:400: Request processed in 23us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683254.440610:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:2.0:1789683254.440625:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683254.440630:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683254.441145:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802892544 00000100:00100000:3.0:1789683254.441152:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802892544 00000100:00100000:3.0:1789683254.441212:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1789683254.441219:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802892544:12345-192.168.203.60@tcp:400: 00000100:00100000:3.0:1789683254.441260:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802892544:12345-192.168.203.60@tcp:400: Request processed in 42us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683254.441265:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00080000:2.0:1789683254.441462:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683254.441898:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802892416 00000100:00100000:1.0:1789683254.441906:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802892416 00000100:00100000:1.0:1789683254.441991:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:1.0:1789683254.442001:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802892416:12345-192.168.203.60@tcp:400: 00000100:00100000:1.0:1789683254.442055:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802892416:12345-192.168.203.60@tcp:400: Request processed in 56us (1941us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683254.442062:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00010000:00010000:3.0:1789683254.623921:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683255.650355:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683255.776175:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683255.776208:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815496576:0@lo:13: 00000100:00100000:1.0:1789683255.776316:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683255.776399:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815496576 00000100:00100000:1.0:1789683255.776409:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815496576 00000100:00100000:1.0:1789683255.776484:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789683255.776495:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815496576:12345-0@lo:13: 00002000:00000024:1.0:1789683255.776541:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683255.776592:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815496576:12345-0@lo:13: Request processed in 100us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683255.776599:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789683255.776669:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76a1b100 x1876618815496576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683271 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683255.776727:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815496576:0@lo:13: 00000100:00080000:3.0:1789683255.777772:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:1.0:1789683256.018946:0:8293:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789683256.676743:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683257.702699:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683257.825115:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815496704:0@lo:13: 00000100:00100000:0.0:1789683257.825223:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683257.825560:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815496704 00000100:00100000:0.0:1789683257.825571:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815496704 00000100:00100000:0.0:1789683257.825631:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683257.825642:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815496704:12345-0@lo:13: 00002000:00000024:0.0:1789683257.825707:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683257.825759:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815496704:12345-0@lo:13: Request processed in 119us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683257.825767:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789683257.826928:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789683257.826988:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6a8a80 x1876618815496704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683273 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683257.827017:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815496704:0@lo:13: 00000100:00100000:2.0:1789683257.827256:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815496960:0@lo:400: 00000100:00100000:2.0:1789683257.827322:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683257.827353:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683257.827359:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815497088:0@lo:400: 00000100:00100000:2.0:1789683257.827379:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683257.827409:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815496960 00000100:00100000:2.0:1789683257.827415:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815496960 00000100:00100000:2.0:1789683257.827457:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815497088 00000100:00100000:2.0:1789683257.827459:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815497088 00000100:00100000:2.0:1789683257.827484:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789683257.827492:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815496960:12345-0@lo:400: 00000100:00100000:2.0:1789683257.827538:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815496960:12345-0@lo:400: Request processed in 45us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683257.827544:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789683257.827559:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683257.827564:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815497088:12345-0@lo:400: 00000100:00100000:2.0:1789683257.827588:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815497088:12345-0@lo:400: Request processed in 24us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683257.827592:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683257.827614:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815497088:0@lo:400: 00000100:00100000:2.0:1789683257.827623:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815496960:0@lo:400: 00000100:00100000:2.0:1789683257.827670:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815496832:0@lo:400: 00000100:00100000:2.0:1789683257.827717:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683257.827742:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815497344:0@lo:400: 00000100:00100000:2.0:1789683257.827764:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683257.827777:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683257.827782:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815497216:0@lo:400: 00000100:00100000:2.0:1789683257.827887:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683257.827910:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815497344 00000100:00100000:2.0:1789683257.827913:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815497344 00000100:00100000:2.0:1789683257.827935:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683257.827939:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815497344:12345-0@lo:400: 00000100:00100000:2.0:1789683257.827967:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815497344:12345-0@lo:400: Request processed in 28us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683257.827973:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683257.827988:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815497216 00000100:00100000:2.0:1789683257.827992:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815497216 00000100:00100000:2.0:1789683257.828019:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683257.828025:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815497216:12345-0@lo:400: 00000100:00100000:2.0:1789683257.828054:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815497216:12345-0@lo:400: Request processed in 30us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683257.828059:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1789683257.828085:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7b94a680 x1876618815497216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683273 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683257.828095:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815497216:0@lo:400: 00000100:00100000:2.0:1789683257.828104:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b949500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815497344:0@lo:400: 00000100:00100000:2.0:1789683257.828157:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815496832 00000100:00100000:2.0:1789683257.828162:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815496832 00000100:00100000:2.0:1789683257.828187:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789683257.828194:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815496832:12345-0@lo:400: 00000100:00100000:2.0:1789683257.828232:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815496832:12345-0@lo:400: Request processed in 39us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683257.828239:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789683257.828280:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815496832:0@lo:400: 00000100:00080000:0.0:1789683257.828487:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683257.828492:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789683258.722825:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683259.559572:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683259.559622:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683259.559652:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683259.559700:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683259.559738:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802893184 00000100:00100000:2.0:1789683259.559750:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802893184 00000100:00100000:2.0:1789683259.559816:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802893312 00000100:00100000:2.0:1789683259.559820:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802893312 00000100:00100000:2.0:1789683259.559840:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1789683259.559851:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802893184:12345-192.168.203.60@tcp:400: 00000100:00100000:2.0:1789683259.559944:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802893184:12345-192.168.203.60@tcp:400: Request processed in 95us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683259.559953:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1789683259.559974:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1789683259.559981:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802893312:12345-192.168.203.60@tcp:400: 00000100:00100000:2.0:1789683259.560007:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802893312:12345-192.168.203.60@tcp:400: Request processed in 27us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683259.560013:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1789683259.560032:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802893056 00000100:00100000:2.0:1789683259.560036:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802893056 00000100:00100000:2.0:1789683259.560065:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1789683259.560071:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802893056:12345-192.168.203.60@tcp:400: 00000100:00100000:2.0:1789683259.560105:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802893056:12345-192.168.203.60@tcp:400: Request processed in 34us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683259.560112:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00080000:2.0:1789683259.560160:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683259.560166:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683259.560168:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683259.561812:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802892928 00000100:00100000:3.0:1789683259.561838:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802892928 00000100:00100000:3.0:1789683259.561896:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:3.0:1789683259.561906:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802892928:12345-192.168.203.60@tcp:400: 00000100:00100000:3.0:1789683259.561977:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802892928:12345-192.168.203.60@tcp:400: Request processed in 73us (2420us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683259.561986:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00010000:00010000:1.0:1789683259.747254:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683260.768058:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683260.896888:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815497472:0@lo:13: 00000100:00100000:3.0:1789683260.897016:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683260.897131:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815497472 00000100:00100000:3.0:1789683260.897150:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815497472 00000100:00100000:3.0:1789683260.897907:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683260.897922:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815497472:12345-0@lo:13: 00002000:00000024:3.0:1789683260.897974:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683260.898057:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815497472:12345-0@lo:13: Request processed in 142us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683260.898064:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1789683260.898096:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789683260.898145:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76a1b100 x1876618815497472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683276 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683260.898172:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815497472:0@lo:13: 00010000:00010000:2.0:1789683261.805087:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789683262.067960:0:8441:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd9960380 20000000:00000080:2.0:1789683262.067981:0:8441:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dbe7d65cc00 uarg=0000000000000000 20000000:01000000:2.0:1789683262.068022:0:8441:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789683262.068025:0:8441:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789683262.068028:0:8441:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789683262.068033:0:8441:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789683262.068039:0:8441:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789683262.068056:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789683262.068059:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789683262.068323:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789683262.068327:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789683262.069628:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789683262.070355:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789683262.070433:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789683262.070473:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1789683262.070486:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789683262.070490:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789683262.071905:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1789683262.073099:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1789683262.073176:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1789683262.073226:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1789683262.073241:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789683262.073244:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789683262.074747:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1789683262.075629:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1789683262.075748:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1789683262.076312:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1789683262.076333:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1789683262.076336:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1789683262.085498:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1789683262.086439:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1789683262.086515:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1789683262.086554:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1789683262.086573:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789683262.086597:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086618:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe87e expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086627:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe8a8 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086634:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe8d2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086640:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe8e0 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086647:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe8ee expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086654:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe90a expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086661:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe92d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086722:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efebc expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086730:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efec3 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086737:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086805:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efec3 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086823:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efec3 expref: 9 pid: 5823 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.086848:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53098000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815497600:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683262.086963:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efebc expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.086971:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efebc expref: 9 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.086980:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815497728:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683262.087003:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe92d expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.087011:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe92d expref: 18 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.087030:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815497856:0@lo:104: 00000100:00100000:3.0:1789683262.087074:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683262.087119:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe90a expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.087127:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe90a expref: 18 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.087135:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815497984:0@lo:104: 00000100:00100000:3.0:1789683262.087159:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683262.087186:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe8ee expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.087195:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe8ee expref: 18 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.087202:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53098380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498112:0@lo:104: 00010000:00010000:3.0:1789683262.087226:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe8e0 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.087234:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe8e0 expref: 18 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.087240:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498240:0@lo:104: 00010000:00010000:3.0:1789683262.087261:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe8d2 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.087268:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe8d2 expref: 18 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.087282:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498368:0@lo:104: 00010000:00010000:3.0:1789683262.087305:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe8a8 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.087313:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe8a8 expref: 18 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.087320:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498496:0@lo:104: 00010000:00010000:3.0:1789683262.087344:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe87e expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683262.087350:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe87e expref: 18 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.087357:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498624:0@lo:104: 00000100:00100000:3.0:1789683262.087376:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53125f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683262.087908:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789683262.087929:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.087956:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.087964:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.087973:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.087980:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.087988:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815497856 00000100:00100000:1.0:1789683262.087995:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815497856 00000100:00100000:1.0:1789683262.088035:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815497984 00000100:00100000:1.0:1789683262.088037:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815497984 00000100:00100000:1.0:1789683262.088045:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815498112 00000100:00100000:1.0:1789683262.088047:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815498112 00000100:00100000:0.0:1789683262.088555:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815498240 00000100:00100000:0.0:1789683262.088561:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815498240 00000100:00100000:0.0:1789683262.088587:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815498368 00000100:00100000:0.0:1789683262.088590:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815498368 00000100:00100000:0.0:1789683262.088603:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815498496 00000100:00100000:0.0:1789683262.088607:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815498496 00000100:00100000:0.0:1789683262.088618:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815498624 00000100:00100000:0.0:1789683262.088621:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815498624 00000100:00100000:0.0:1789683262.088638:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683262.088649:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+9:8441:x1876618815497856:12345-0@lo:104: 00010000:00010000:0.0:1789683262.088666:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.088797:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789683262.088805:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+9:8441:x1876618815497856:12345-0@lo:104: Request processed in 158us (1730us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.088813:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683262.088850:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683262.088860:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbd44ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+8:8441:x1876618815497984:12345-0@lo:104: 00010000:00010000:0.0:1789683262.088870:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.088911:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789683262.088917:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbd44ee9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+8:8441:x1876618815497984:12345-0@lo:104: Request processed in 60us (1757us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.088924:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683262.088966:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683262.088973:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+7:8441:x1876618815498240:12345-0@lo:104: 00010000:00010000:0.0:1789683262.088981:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.089026:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789683262.089034:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+7:8441:x1876618815498240:12345-0@lo:104: Request processed in 61us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.089041:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683262.089056:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683262.089078:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+6:8441:x1876618815498368:12345-0@lo:104: 00010000:00010000:0.0:1789683262.089088:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.089138:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789683262.089349:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683262.089358:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+6:8441:x1876618815498496:12345-0@lo:104: 00010000:00010000:1.0:1789683262.089367:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.089401:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789683262.089406:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+6:8441:x1876618815498496:12345-0@lo:104: Request processed in 51us (1432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683262.089411:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683262.089423:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683262.089429:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+5:8441:x1876618815498624:12345-0@lo:104: 00010000:00010000:1.0:1789683262.089437:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.089465:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789683262.089469:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+5:8441:x1876618815498624:12345-0@lo:104: Request processed in 41us (1488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683262.089474:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683262.089485:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683262.089490:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+4:8441:x1876618815498112:12345-0@lo:104: 00010000:00010000:1.0:1789683262.089497:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.089523:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789683262.089528:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+4:8441:x1876618815498112:12345-0@lo:104: Request processed in 38us (1598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683262.089533:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789683262.089826:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:8441:x1876618815498368:12345-0@lo:104: Request processed in 764us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.089832:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1789683262.089858:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789683262.089865:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.089872:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe4583a200 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683262.089877:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.089888:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683262.089895:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683262.089901:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683262.089940:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.089948:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683262.089969:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.089976:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe4583a200/0x59bee33f93fe92d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe93b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.090000:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789683262.090004:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.090010:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683262.090014:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.090021:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683262.090026:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683262.090031:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683262.090043:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.090048:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683262.090920:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.090932:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8200/0x59bee33f93fe90a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe911 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.090947:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789683262.090951:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.090970:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8600 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683262.090974:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.090982:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683262.090989:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683262.090994:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683262.091013:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091019:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683262.091027:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091033:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93fe8e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8e7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091043:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789683262.091046:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091052:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8c600 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683262.091055:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091306:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683262.091312:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683262.091318:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683262.091344:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091351:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683262.091357:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091362:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c600/0x59bee33f93fe8d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8d9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091371:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789683262.091374:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091380:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8c400 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683262.091383:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091390:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683262.091396:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683262.091408:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683262.091424:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091430:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683262.091435:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091442:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8c400/0x59bee33f93fe8a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8af expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091451:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683262.091456:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091463:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8400 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683262.091466:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091474:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683262.091482:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683262.091487:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683262.091502:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091509:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683262.091523:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091530:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8400/0x59bee33f93fe87e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe885 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091540:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683262.091543:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091549:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2400 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683262.091552:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091559:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683262.091565:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683262.091570:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683262.091583:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091589:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683262.091593:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091600:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2400/0x59bee33f93fe8ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8f5 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.091614:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683262.091622:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683262.091624:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683262.091634:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683262.091654:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815498752:0@lo:103: 00000100:00100000:0.0:1789683262.091745:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683262.091811:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815499264:0@lo:103: 00010000:00010000:2.0:1789683262.092706:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683262.092719:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815499008:0@lo:103: 00000100:00100000:2.0:1789683262.094537:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815498880:0@lo:103: 00000100:00100000:2.0:1789683262.094607:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815499136:0@lo:103: 00000100:00100000:0.0:1789683262.094706:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683262.094820:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815498752 00000100:00100000:0.0:1789683262.094843:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815498752 00010000:00010000:0.0:1789683262.094884:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe92d expref: 19 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683262.094917:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815499264 00000100:00100000:0.0:1789683262.094921:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815499264 00010000:00010000:0.0:1789683262.094933:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe8a8 expref: 20 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683262.094953:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683262.094962:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+20:3303:x1876618815498752:12345-0@lo:103: 00010000:00010000:0.0:1789683262.094977:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683262.094983:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe92d expref: 20 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.094995:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe92d expref: 20 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.095019:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683262.095058:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+20:3303:x1876618815498752:12345-0@lo:103: Request processed in 97us (3313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.095076:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683262.095120:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683262.095126:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815499264:12345-0@lo:103: 00010000:00010000:0.0:1789683262.095134:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683262.095138:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe8a8 expref: 19 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.095154:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe8a8 expref: 19 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.095163:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683262.095185:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815499264:12345-0@lo:103: Request processed in 59us (3349us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.095191:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789683262.095220:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683262.095240:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815499520:0@lo:103: 00000100:00100000:0.0:1789683262.095263:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683262.095292:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815499008 00000100:00100000:0.0:1789683262.095296:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815499008 00010000:00010000:0.0:1789683262.095309:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe8e0 expref: 19 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683262.095323:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815499520 00000100:00100000:0.0:1789683262.095326:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815499520 00010000:00010000:0.0:1789683262.095335:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe8ee expref: 20 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683262.095346:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683262.095350:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+20:3305:x1876618815499008:12345-0@lo:103: 00010000:00010000:0.0:1789683262.095357:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683262.095368:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe8e0 expref: 20 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.095376:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe8e0 expref: 20 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.095385:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683262.095413:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+20:3305:x1876618815499008:12345-0@lo:103: Request processed in 62us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.095418:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683262.095431:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683262.095436:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815499520:12345-0@lo:103: 00010000:00010000:0.0:1789683262.095443:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683262.095447:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe8ee expref: 19 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.095454:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe8ee expref: 19 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.095462:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683262.095481:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815499520:12345-0@lo:103: Request processed in 45us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.095487:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683262.095525:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815499008:0@lo:103: 00000100:00100000:0.0:1789683262.095534:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815499520:0@lo:103: 00000100:00100000:0.0:1789683262.095561:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815498752:0@lo:103: 00000100:00100000:0.0:1789683262.095567:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815499264:0@lo:103: 00010000:00010000:3.0:1789683262.095884:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e2600/0x59bee33f93fe93b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe92d expref: 18 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.095899:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815497856:0@lo:104: 00000100:00100000:3.0:1789683262.095909:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815497984:0@lo:104: 00010000:00010000:3.0:1789683262.095919:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93fe8f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe8ee expref: 17 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.095927:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53098380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498112:0@lo:104: 00010000:00010000:3.0:1789683262.095936:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fe8e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe8e0 expref: 16 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.095956:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498240:0@lo:104: 00000100:00100000:3.0:1789683262.095968:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498368:0@lo:104: 00010000:00010000:3.0:1789683262.095977:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8d200/0x59bee33f93fe8af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe8a8 expref: 15 pid: 5821 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683262.095984:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498496:0@lo:104: 00000100:00100000:3.0:1789683262.095994:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815498624:0@lo:104: 00000100:00100000:3.0:1789683262.097366:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.097528:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815499136 00000100:00100000:1.0:1789683262.097548:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815499136 00010000:00010000:1.0:1789683262.097585:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe8d2 expref: 15 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683262.097617:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683262.097626:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+15:3302:x1876618815499136:12345-0@lo:103: 00010000:00010000:1.0:1789683262.097641:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683262.097645:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe8d2 expref: 15 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.097655:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe8d2 expref: 15 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.097693:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fe8d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe8d2 expref: 15 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.097710:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683262.097772:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+14:3302:x1876618815499136:12345-0@lo:103: Request processed in 148us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683262.097778:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683262.097847:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815499136:0@lo:103: 00000100:00100000:1.0:1789683262.099355:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.099413:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815499392:0@lo:103: 00000100:00100000:1.0:1789683262.099471:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.099514:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815498880 00000100:00100000:1.0:1789683262.099521:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815498880 00010000:00010000:1.0:1789683262.099553:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe90a expref: 14 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683262.099579:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815499392 00000100:00100000:1.0:1789683262.099594:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815499392 00010000:00010000:1.0:1789683262.099606:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe87e expref: 15 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683262.099619:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683262.099625:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+15:3304:x1876618815498880:12345-0@lo:103: 00010000:00010000:1.0:1789683262.099638:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683262.099643:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe90a expref: 15 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.099652:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe90a expref: 15 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.099685:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e2c00/0x59bee33f93fe911 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe90a expref: 15 pid: 5822 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.099701:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683262.099731:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+14:3304:x1876618815498880:12345-0@lo:103: Request processed in 106us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683262.099737:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683262.099763:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683262.099770:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+13:3304:x1876618815499392:12345-0@lo:103: 00010000:00010000:1.0:1789683262.099777:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683262.099780:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe87e expref: 13 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.099788:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe87e expref: 13 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.099798:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fe885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe87e expref: 13 pid: 5823 timeout: 345 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683262.099813:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683262.099948:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496c7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+12:3304:x1876618815499392:12345-0@lo:103: Request processed in 179us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683262.099954:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789683262.100020:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815498880:0@lo:103: 00000100:00100000:1.0:1789683262.100029:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815499392:0@lo:103: 00000100:00100000:3.0:1789683262.101076:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53098000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815497600:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683262.101089:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1876618815497728:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683262.101144:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683262.101650:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683262.101707:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683262.101732:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802893440 00000100:00100000:0.0:1789683262.101740:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802893440 00010000:00010000:0.0:1789683262.101773:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efec3 expref: 10 pid: 5823 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683262.101795:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802893568 00000100:00100000:0.0:1789683262.101798:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802893568 00010000:00010000:0.0:1789683262.101808:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efebc expref: 11 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683262.103292:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1789683262.103309:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85ca73fa-7ddf-4820-b817-0961de675c61+11:2353:x1876618802893440:12345-192.168.203.60@tcp:103: 00010000:00010000:0.0:1789683262.103331:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683262.103341:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efec3 expref: 11 pid: 5823 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103358:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efec3 expref: 11 pid: 5823 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103379:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe4583b000/0x59bee33f93fe950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efec3 expref: 11 pid: 5823 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103406:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683262.103484:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85ca73fa-7ddf-4820-b817-0961de675c61+10:2353:x1876618802893440:12345-192.168.203.60@tcp:103: Request processed in 181us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.103493:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1789683262.103514:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1789683262.103540:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85ca73fa-7ddf-4820-b817-0961de675c61+9:2353:x1876618802893568:12345-192.168.203.60@tcp:103: 00010000:00010000:0.0:1789683262.103549:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683262.103554:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efebc expref: 9 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103563:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efebc expref: 9 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103573:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e3200/0x59bee33f93fe949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efebc expref: 9 pid: 5822 timeout: 295 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103585:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103595:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103616:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103623:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103630:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103637:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103644:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683262.103649:0:7627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103664:0:7627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103700:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.103712:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683262.103737:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85ca73fa-7ddf-4820-b817-0961de675c61+8:2353:x1876618802893568:12345-192.168.203.60@tcp:103: Request processed in 198us (2029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683262.103743:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00010000:00010000:2.0:1789683262.105211:0:8441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683262.105227:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683262.105245:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fe988 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683262.816645:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683262.945555:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815499648:0@lo:400: 00000100:00100000:1.0:1789683262.945625:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.945664:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815500160:0@lo:400: 00000100:00100000:1.0:1789683262.945700:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.945719:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789683262.945724:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815499776:0@lo:400: 00000100:00100000:1.0:1789683262.945740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683262.945751:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815500288:0@lo:400: 00000100:00100000:1.0:1789683262.945768:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683262.945859:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815499648 00000100:00100000:2.0:1789683262.945866:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815499648 00000100:00100000:2.0:1789683262.945906:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789683262.945915:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:3302:x1876618815499648:12345-0@lo:400: 00000100:00100000:2.0:1789683262.945966:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+12:3302:x1876618815499648:12345-0@lo:400: Request processed in 52us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683262.945984:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789683262.946015:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815500160 00000100:00100000:2.0:1789683262.946019:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815500160 00000100:00100000:2.0:1789683262.946049:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815499776 00000100:00100000:2.0:1789683262.946052:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815499776 00000100:00100000:2.0:1789683262.946077:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789683262.946083:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815500160:12345-0@lo:400: 00000100:00100000:2.0:1789683262.946123:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815500160:12345-0@lo:400: Request processed in 40us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683262.946130:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789683262.946140:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789683262.946145:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815499776:12345-0@lo:400: 00000100:00100000:2.0:1789683262.946166:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815499776:12345-0@lo:400: Request processed in 21us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683262.946171:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789683262.946187:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815500288 00000100:00100000:2.0:1789683262.946189:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815500288 00000100:00100000:2.0:1789683262.946209:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683262.946226:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815500288:12345-0@lo:400: 00000100:00100000:2.0:1789683262.946252:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815500288:12345-0@lo:400: Request processed in 27us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683262.946257:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789683262.946272:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683262.946276:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683262.946305:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815499776:0@lo:400: 00010000:00080000:2.0:1789683262.946316:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7b94b800 x1876618815500288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683262.946327:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815500288:0@lo:400: 00000100:00100000:2.0:1789683262.946333:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815499648:0@lo:400: 00000100:00100000:2.0:1789683262.946340:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815500160:0@lo:400: 00000100:00100000:3.0:1789683262.946531:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815499904:0@lo:400: 00000100:00100000:3.0:1789683262.946560:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683262.946584:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683262.946589:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815500032:0@lo:400: 00000100:00100000:3.0:1789683262.946606:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683262.947592:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815500416:0@lo:13: 00000100:00100000:3.0:1789683262.947638:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683262.947693:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815500416 00000100:00100000:3.0:1789683262.947699:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815500416 00000100:00100000:3.0:1789683262.947735:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789683262.947743:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815500416:12345-0@lo:13: 00002000:00000024:3.0:1789683262.947773:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683262.947823:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815500416:12345-0@lo:13: Request processed in 81us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683262.947830:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1789683262.947866:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe53099500 x1876618815500416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683278 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683262.947884:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815500416:0@lo:13: 00000100:00100000:2.0:1789683262.947966:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815500032 00000100:00100000:2.0:1789683262.947980:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815500032 00000100:00100000:2.0:1789683262.948023:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683262.948029:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815500032:12345-0@lo:400: 00000100:00100000:2.0:1789683262.948083:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815500032:12345-0@lo:400: Request processed in 54us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683262.948089:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683262.948119:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815499904 00000100:00100000:2.0:1789683262.948123:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815499904 00000100:00100000:2.0:1789683262.948149:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683262.948155:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815499904:12345-0@lo:400: 00000100:00100000:2.0:1789683262.948188:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815499904:12345-0@lo:400: Request processed in 34us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683262.948202:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1789683262.948231:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7b948000 x1876618815500032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683278 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683262.948239:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815500032:0@lo:400: 00000100:00100000:2.0:1789683262.948249:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815499904:0@lo:400: 00000100:00080000:3.0:1789683262.949399:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683262.949406:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1789683263.520260:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789683263.520268:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe53b2b800 from 39 10000000:01000000:0.0:1789683263.520273:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789683263.520320:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.520331:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.520341:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683263.520364:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815500544:0@lo:101: 00000100:00100000:0.0:1789683263.520440:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683263.520501:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683263.520587:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815500544 00000100:00100000:2.0:1789683263.520596:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815500544 00000100:00100000:2.0:1789683263.520647:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789683263.520656:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+12:5825:x1876618815500544:12345-0@lo:101: 00010000:00010000:2.0:1789683263.520668:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683263.520701:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe98f expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.520739:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe98f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.520750:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe98f expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.520759:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c000, rc 0) 00000100:00100000:2.0:1789683263.520819:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815500544:12345-0@lo:101: Request processed in 164us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683263.520825:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789683263.521459:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815500544:0@lo:101: 00010000:00010000:1.0:1789683263.521478:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.521487:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683263.521588:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815500672:0@lo:501: 00000100:00100000:1.0:1789683263.521623:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.521665:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683263.521742:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815500672 00000100:00100000:2.0:1789683263.521747:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815500672 00000100:00100000:2.0:1789683263.521780:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1789683263.521787:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815500672:12345-0@lo:501: 00000100:00100000:2.0:1789683263.522068:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815500672:12345-0@lo:501: Request processed in 281us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683263.522076:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789683263.522495:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815500672:0@lo:501: 00000100:00100000:1.0:1789683263.522530:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815500800:0@lo:503: 00000100:00100000:1.0:1789683263.522572:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.523137:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683263.523404:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815500800 00000100:00100000:3.0:1789683263.523411:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815500800 00000100:00100000:3.0:1789683263.523460:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789683263.523470:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815500800:12345-0@lo:503: 00000100:00100000:3.0:1789683263.524180:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815500800:12345-0@lo:503: Request processed in 710us (1604us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683263.524189:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1789683263.525232:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815500800:0@lo:503: 00000100:00100000:2.0:1789683263.530592:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8458:1876618815500928:0@lo:502: 00000100:00100000:2.0:1789683263.530698:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683263.530746:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe49603180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683263.531379:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815500928 00000100:00100000:3.0:1789683263.531387:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815500928 00000100:00100000:3.0:1789683263.531444:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789683263.531452:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:8458:x1876618815500928:12345-0@lo:502: 00000100:00100000:3.0:1789683263.531732:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+13:8458:x1876618815500928:12345-0@lo:502: Request processed in 274us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683263.531740:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789683263.531953:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8458:1876618815500928:0@lo:502: 00000100:00100000:2.0:1789683263.532014:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8458:1876618815501056:0@lo:502: 00000100:00100000:2.0:1789683263.532052:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683263.532082:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe49603180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683263.532460:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815501056 00000100:00100000:3.0:1789683263.532465:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815501056 00000100:00100000:3.0:1789683263.532510:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1789683263.532518:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:8458:x1876618815501056:12345-0@lo:502: 00000100:00100000:3.0:1789683263.533221:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:8458:x1876618815501056:12345-0@lo:502: Request processed in 701us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683263.533237:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789683263.533458:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8458:1876618815501056:0@lo:502: 00000040:00080000:1.0:1789683263.533488:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789683263.534271:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789683263.534293:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789683263.534304:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.534315:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683263.534325:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789683263.534328:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1789683263.534330:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789683263.534361:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.534370:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.534381:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683263.534410:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501184:0@lo:101: 00000100:00100000:3.0:1789683263.534457:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683263.534495:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53d550c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683263.535164:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815501184 00000100:00100000:2.0:1789683263.535172:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815501184 00000100:00100000:2.0:1789683263.535220:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789683263.535229:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+13:5825:x1876618815501184:12345-0@lo:101: 00010000:00010000:2.0:1789683263.535241:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683263.535253:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe9a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe99d expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.535275:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe9a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe99d expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.535285:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe9a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe99d expref: 14 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.535293:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c200, rc 0) 00000100:00100000:2.0:1789683263.535344:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815501184:12345-0@lo:101: Request processed in 115us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683263.535363:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789683263.535481:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501184:0@lo:101: 00010000:00010000:1.0:1789683263.535495:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.535513:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683263.535559:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501312:0@lo:501: 00000100:00100000:1.0:1789683263.535594:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.535620:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.535659:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815501312 00000100:00100000:0.0:1789683263.535663:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815501312 00000100:00100000:0.0:1789683263.535716:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789683263.535736:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815501312:12345-0@lo:501: 00000100:00100000:0.0:1789683263.535966:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815501312:12345-0@lo:501: Request processed in 229us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.536262:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789683263.536490:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501312:0@lo:501: 00000100:00100000:1.0:1789683263.536537:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501440:0@lo:503: 00000100:00100000:1.0:1789683263.536593:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.536613:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.537209:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815501440 00000100:00100000:0.0:1789683263.537217:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815501440 00000100:00100000:0.0:1789683263.537255:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789683263.537263:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815501440:12345-0@lo:503: 00000100:00100000:0.0:1789683263.537452:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815501440:12345-0@lo:503: Request processed in 189us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.537459:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1789683263.538390:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501440:0@lo:503: 00000100:00100000:3.0:1789683263.546328:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8459:1876618815501568:0@lo:502: 00000100:00100000:3.0:1789683263.546419:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683263.546459:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53d55180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.548630:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815501568 00000100:00100000:0.0:1789683263.548643:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815501568 00000100:00100000:0.0:1789683263.548741:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789683263.548752:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+14:8459:x1876618815501568:12345-0@lo:502: 00000100:00100000:0.0:1789683263.549312:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+14:8459:x1876618815501568:12345-0@lo:502: Request processed in 561us (2891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.549321:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789683263.551147:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8459:1876618815501568:0@lo:502: 00000020:01000000:3.0:1789683263.551194:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683263.551206:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683263.551209:0:8459:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789683263.551215:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789683263.551250:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8459:1876618815501696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683263.551316:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683263.551361:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53d55180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683263.551443:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815501696 00000100:00100000:2.0:1789683263.551450:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815501696 00000100:00100000:2.0:1789683263.551500:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789683263.551520:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:8459:x1876618815501696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683263.551790:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+14:8459:x1876618815501696:12345-0@lo:502:llog_process_th.0 Request processed in 281us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683263.551797:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789683263.552269:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8459:1876618815501696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683263.552295:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683263.552300:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683263.552302:0:8459:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789683263.552306:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:1.0:1789683263.552468:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:1.0:1789683263.552488:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789683263.552498:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.552517:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683263.552526:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789683263.552529:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe52f3c000 from 39 10000000:01000000:1.0:1789683263.552531:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683263.552557:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.552565:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.552573:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683263.552601:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.552636:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.552660:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.553484:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815501824 00000100:00100000:0.0:1789683263.553493:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815501824 00000100:00100000:0.0:1789683263.553553:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789683263.553562:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+14:5825:x1876618815501824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683263.553584:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683263.553599:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe4583a200/0x59bee33f93fe9b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe9ab expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.553624:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe4583a200/0x59bee33f93fe9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe9ab expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.553643:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe4583a200/0x59bee33f93fe9b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe9ab expref: 15 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.553651:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe4583a200, rc 0) 00000100:00100000:0.0:1789683263.553724:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815501824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.553740:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789683263.555233:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683263.555255:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.555266:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683263.555336:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.555378:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.555433:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683263.558136:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815501952 00000100:00100000:2.0:1789683263.558151:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815501952 00000100:00100000:2.0:1789683263.558220:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789683263.558230:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815501952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683263.558553:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815501952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 324us (3173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683263.558560:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789683263.562965:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815501952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683263.563043:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815502080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683263.563126:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683263.563169:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53d55180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.563557:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815502080 00000100:00100000:0.0:1789683263.563565:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815502080 00000100:00100000:0.0:1789683263.563619:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1789683263.563628:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815502080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683263.563866:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815502080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 239us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.563875:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789683263.563989:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815502080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.568550:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8460:1876618815502208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683263.568643:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.568722:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.568850:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815502208 00000100:00100000:0.0:1789683263.568858:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815502208 00000100:00100000:0.0:1789683263.568903:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789683263.568922:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+15:8460:x1876618815502208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683263.569190:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+15:8460:x1876618815502208:12345-0@lo:502:llog_process_th.0 Request processed in 279us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.569199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789683263.570047:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8460:1876618815502208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683263.570119:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8460:1876618815502336:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683263.570165:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.570398:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683263.579176:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815502336 00000100:00100000:2.0:1789683263.579192:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815502336 00000100:00100000:2.0:1789683263.579261:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789683263.579271:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:8460:x1876618815502336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683263.579585:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+15:8460:x1876618815502336:12345-0@lo:502:llog_process_th.0 Request processed in 304us (9409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683263.579593:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1789683263.580638:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8460:1876618815502336:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789683263.580727:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1789683263.581002:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1789683263.581032:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789683263.581042:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.581053:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683263.581063:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789683263.581065:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1789683263.581068:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789683263.581115:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.581123:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.581133:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683263.581167:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815502464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.581216:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.581265:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8900 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.582453:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815502464 00000100:00100000:0.0:1789683263.582464:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815502464 00000100:00100000:0.0:1789683263.582544:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789683263.582554:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+15:5825:x1876618815502464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683263.582569:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683263.582584:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe9c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe9b9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.582611:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe9b9 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.582623:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe9c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe9b9 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.582632:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe4583be00, rc 0) 00000100:00100000:0.0:1789683263.582721:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815502464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.582728:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789683263.583383:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815502464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683263.583400:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.583410:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683263.583475:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815502592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.583522:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.583551:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683263.583655:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815502592 00000100:00100000:2.0:1789683263.583661:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815502592 00000100:00100000:2.0:1789683263.583730:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789683263.583739:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815502592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683263.583997:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815502592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683263.584005:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789683263.589028:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815502592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.589105:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815502720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.589181:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.589247:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8900 going to sleep for 11 seconds 00000100:00100000:3.0:1789683263.589500:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815502720 00000100:00100000:3.0:1789683263.589508:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815502720 00000100:00100000:3.0:1789683263.589565:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789683263.589586:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815502720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683263.589836:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815502720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 262us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683263.589845:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789683263.589869:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815502720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683263.594395:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8461:1876618815502848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683263.594483:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683263.594520:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683263.594579:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815502848 00000100:00100000:1.0:1789683263.594587:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815502848 00000100:00100000:1.0:1789683263.594632:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789683263.594641:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+16:8461:x1876618815502848:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683263.594886:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+16:8461:x1876618815502848:12345-0@lo:502:llog_process_th.0 Request processed in 245us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683263.594893:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789683263.595362:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8461:1876618815502848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683263.595390:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683263.595398:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683263.595401:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789683263.595405:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789683263.595428:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8461:1876618815502976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683263.595465:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683263.595493:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683263.596213:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815502976 00000100:00100000:1.0:1789683263.596221:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815502976 00000100:00100000:1.0:1789683263.596269:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789683263.596277:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+16:8461:x1876618815502976:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683263.596471:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+16:8461:x1876618815502976:12345-0@lo:502:llog_process_th.0 Request processed in 193us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683263.596479:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789683263.596566:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8461:1876618815502976:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683263.596591:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683263.596601:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683263.596603:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789683263.596607:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789683263.597489:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789683263.597512:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789683263.597523:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.597535:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683263.597546:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789683263.597549:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe46fc8800 from 39 10000000:01000000:1.0:1789683263.597552:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683263.597583:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.597591:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683263.597601:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683263.597620:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.597664:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.597751:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683263.597817:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815503104 00000100:00100000:3.0:1789683263.597823:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815503104 00000100:00100000:3.0:1789683263.597875:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789683263.597882:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815503104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683263.597893:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683263.597905:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9800/0x59bee33f93fe9ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe9c7 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.597926:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9800/0x59bee33f93fe9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe9c7 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.597937:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9800/0x59bee33f93fe9ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe9c7 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.597944:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9800, rc 0) 00000100:00100000:3.0:1789683263.597979:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815503104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683263.597985:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789683263.598135:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683263.598148:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.598156:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683263.598203:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683263.598242:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683263.598272:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683263.600163:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815503232 00000100:00100000:3.0:1789683263.600174:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815503232 00000100:00100000:3.0:1789683263.600239:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789683263.600249:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815503232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683263.600527:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815503232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683263.600535:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789683263.600749:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683263.600796:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683263.600840:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683263.600869:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683263.601010:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815503360 00000100:00100000:1.0:1789683263.601025:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815503360 00000100:00100000:1.0:1789683263.601058:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789683263.601065:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815503360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.601236:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815503360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683263.601244:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789683263.601424:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683263.602255:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8462:1876618815503488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683263.602302:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683263.602344:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683263.602474:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815503488 00000100:00100000:1.0:1789683263.602480:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815503488 00000100:00100000:1.0:1789683263.602516:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789683263.602524:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+17:8462:x1876618815503488:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683263.602764:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+17:8462:x1876618815503488:12345-0@lo:502:llog_process_th.0 Request processed in 240us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683263.602770:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1789683263.602854:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8462:1876618815503488:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683263.602896:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8462:1876618815503616:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683263.602932:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683263.602956:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe49603c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683263.603055:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815503616 00000100:00100000:3.0:1789683263.603066:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815503616 00000100:00100000:3.0:1789683263.603110:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789683263.603118:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:8462:x1876618815503616:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683263.603260:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:8462:x1876618815503616:12345-0@lo:502:llog_process_th.0 Request processed in 142us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683263.603266:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789683263.603452:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8462:1876618815503616:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789683263.603474:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789683263.604811:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789683263.604835:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789683263.604846:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.604857:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683263.604866:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789683263.604868:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789683263.604871:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789683263.604903:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.604911:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.604921:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683263.604942:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683263.604991:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683263.605037:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53125f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.607157:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815503744 00000100:00100000:0.0:1789683263.607171:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815503744 00000100:00100000:0.0:1789683263.607241:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789683263.607251:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815503744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683263.607268:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683263.607286:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe4583ae00/0x59bee33f93fe9dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe9d5 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.607328:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe4583ae00/0x59bee33f93fe9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe9d5 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.607338:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe4583ae00/0x59bee33f93fe9dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe9d5 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.607347:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe4583ae00, rc 0) 00000100:00100000:0.0:1789683263.607416:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815503744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (2424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.607423:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1789683263.609420:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683263.609448:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683263.609460:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683263.609539:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683263.609596:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683263.609641:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53125f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.611736:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815503872 00000100:00100000:0.0:1789683263.611749:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815503872 00000100:00100000:0.0:1789683263.611800:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789683263.611809:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815503872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683263.612121:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815503872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (2523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.612128:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789683263.612432:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815503872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683263.612479:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815504000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683263.612523:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683263.612562:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b3b180 going to sleep for 11 seconds 00000100:00100000:1.0:1789683263.612705:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815504000 00000100:00100000:1.0:1789683263.612710:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815504000 00000100:00100000:1.0:1789683263.612741:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789683263.612749:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815504000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.612901:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815504000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683263.612908:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789683263.620219:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815504000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683263.624800:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8463:1876618815504128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683263.624889:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.624940:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8240 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.625201:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815504128 00000100:00100000:0.0:1789683263.625209:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815504128 00000100:00100000:0.0:1789683263.625255:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789683263.625264:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:8463:x1876618815504128:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683263.625512:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:8463:x1876618815504128:12345-0@lo:502:llog_process_th.0 Request processed in 248us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.625530:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789683263.626865:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8463:1876618815504128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683263.626920:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683263.626930:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683263.626932:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789683263.626938:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789683263.626969:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8463:1876618815504256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683263.627035:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683263.627075:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52b4fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.627160:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815504256 00000100:00100000:0.0:1789683263.627168:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815504256 00000100:00100000:0.0:1789683263.627229:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789683263.627237:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:8463:x1876618815504256:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683263.627457:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:8463:x1876618815504256:12345-0@lo:502:llog_process_th.0 Request processed in 220us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.627464:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789683263.627612:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8463:1876618815504256:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683263.627633:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683263.627637:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683263.627639:0:8463:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789683263.627642:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1789683263.627914:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1789683263.627936:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789683263.627946:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.627957:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683263.627967:0:5825:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789683263.627969:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dbe48a44d40 from 1 10000000:01000000:2.0:1789683263.627979:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789683263.628005:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.628022:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.628031:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683263.628046:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815504384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683263.628079:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683263.628115:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b3b180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683263.628579:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815504384 00000100:00100000:0.0:1789683263.628586:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815504384 00000100:00100000:0.0:1789683263.628636:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789683263.628645:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815504384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683263.628656:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683263.628668:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe4583a400/0x59bee33f93fe9ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fe9e3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.628909:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe4583a400/0x59bee33f93fe9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fe9e3 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.628919:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe4583a400/0x59bee33f93fe9ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe9e3 expref: 19 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.628928:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe4583a400, rc 0) 00000100:00100000:0.0:1789683263.628979:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815504384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 335us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683263.628985:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789683263.629156:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815504384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683263.629172:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.629181:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683263.629240:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815504512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683263.629268:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683263.629303:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b3b180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683263.629321:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815504512 00000100:00100000:3.0:1789683263.629327:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815504512 00000100:00100000:3.0:1789683263.629360:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789683263.629367:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815504512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683263.629598:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815504512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (328us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789683263.629605:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789683263.629737:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815504512:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789683263.629760:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789683263.629766:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683263.629785:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683263.840989:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683264.098414:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683264.098529:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802893696 00000100:00100000:1.0:1789683264.098539:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802893696 00000100:00100000:1.0:1789683264.098595:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00100000:1.0:1789683264.098605:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+8:5588:x1876618802893696:12345-192.168.203.60@tcp:101: 00010000:00010000:1.0:1789683264.098621:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683264.098638:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe820e2400/0x59bee33f93fe9f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449eff25 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683264.098667:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e2400/0x59bee33f93fe9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff25 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683264.098713:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe820e2400/0x59bee33f93fe9f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff25 expref: 9 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683264.098722:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e2400, rc 0) 00000100:00100000:1.0:1789683264.098767:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+9:5588:x1876618802893696:12345-192.168.203.60@tcp:101: Request processed in 163us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683264.098787:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00100000:1.0:1789683264.102279:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683264.102769:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802893824 00000100:00100000:3.0:1789683264.102779:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802893824 00000100:00100000:3.0:1789683264.102833:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:3.0:1789683264.102844:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+9:5588:x1876618802893824:12345-192.168.203.60@tcp:501: 00000100:00100000:3.0:1789683264.103160:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+9:5588:x1876618802893824:12345-192.168.203.60@tcp:501: Request processed in 317us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683264.103168:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:0.0:1789683264.106099:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683264.106202:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802893952 00000100:00100000:1.0:1789683264.106212:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802893952 00000100:00100000:1.0:1789683264.106268:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:1.0:1789683264.106277:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+9:5588:x1876618802893952:12345-192.168.203.60@tcp:503: 00000100:00100000:1.0:1789683264.106503:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+9:5588:x1876618802893952:12345-192.168.203.60@tcp:503: Request processed in 226us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683264.106511:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:0.0:1789683264.112826:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683264.112963:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802894080 00000100:00100000:1.0:1789683264.112973:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802894080 00000100:00100000:1.0:1789683264.113031:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:1.0:1789683264.113042:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+9:6062:x1876618802894080:12345-192.168.203.60@tcp:502: 00000100:00100000:1.0:1789683264.113336:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+9:6062:x1876618802894080:12345-192.168.203.60@tcp:502: Request processed in 295us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683264.113344:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:0.0:1789683264.118949:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683264.119076:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802894208 00000100:00100000:3.0:1789683264.119086:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802894208 00000100:00100000:3.0:1789683264.119148:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:3.0:1789683264.119164:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+9:6062:x1876618802894208:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683264.119444:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+9:6062:x1876618802894208:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 281us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683264.119452:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:0.0:1789683264.122434:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683264.122596:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802894336 00000100:00100000:2.0:1789683264.122606:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802894336 00000100:00100000:2.0:1789683264.122660:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:2.0:1789683264.122709:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+9:5588:x1876618802894336:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683264.122727:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683264.122746:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8cc00/0x59bee33f93fe9f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449eff2c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683264.122774:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8cc00/0x59bee33f93fe9f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff2c expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683264.122784:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8cc00/0x59bee33f93fe9f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff2c expref: 10 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683264.122793:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8cc00, rc 0) 00000100:00100000:2.0:1789683264.122837:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:5588:x1876618802894336:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 169us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683264.122844:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:0.0:1789683264.126971:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683264.127176:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802894464 00000100:00100000:1.0:1789683264.127186:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802894464 00000100:00100000:1.0:1789683264.127240:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:1.0:1789683264.127249:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:5588:x1876618802894464:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683264.127534:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:5588:x1876618802894464:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 284us (569us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683264.127542:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:0.0:1789683264.685017:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683264.685065:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683264.685102:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802894720 00000100:00100000:2.0:1789683264.685112:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802894720 00000100:00100000:0.0:1789683264.685114:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00080000:0.0:1789683264.685156:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683264.685168:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802894848 00000100:00100000:2.0:1789683264.685171:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802894848 00000100:00100000:0.0:1789683264.685174:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1789683264.685185:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802894720:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683264.685188:0:6676:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789683264.685195:0:6676:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1789683264.685264:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802894720:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 81us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683264.685271:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00080000:2.0:1789683264.685272:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683264.685302:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1789683264.685308:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802894848:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683264.685332:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802894848:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683264.685337:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1789683264.685422:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802894592 00000100:00100000:3.0:1789683264.685426:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802894592 00000100:00100000:3.0:1789683264.685485:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1789683264.685494:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802894592:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683264.685545:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802894592:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 52us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683264.685551:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00080000:2.0:1789683264.686770:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789683264.864314:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683265.887838:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683266.016317:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683266.016340:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815504640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683266.016405:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683266.017272:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815504640 00000100:00100000:1.0:1789683266.017281:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815504640 00000100:00100000:1.0:1789683266.017351:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683266.017361:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815504640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683266.017396:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683266.017449:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815504640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1044us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683266.017456:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1789683266.017511:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789683266.017568:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d03800 x1876618815504640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683266.017594:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815504640:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1789683266.244993:0:8502:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdea044270 20000000:00000080:0.0:1789683266.245018:0:8502:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dbd44f39000 uarg=0000000000000000 20000000:01000000:0.0:1789683266.245069:0:8502:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789683266.245084:0:8502:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789683266.245090:0:8502:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789683266.245941:0:8503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789683266.247633:0:8502:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789683266.261583:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789683266.261659:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789683266.261756:0:8502:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789683266.261774:0:8502:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789683266.261795:0:8502:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.261813:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe44431600/0x59bee33f93fe774 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe76d expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.261822:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe7cf expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.261828:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fe89a expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.261838:0:8502:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efef4 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.261846:0:8502:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.261886:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efef4 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.261902:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efef4 expref: 9 pid: 5821 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.261931:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876618815504768:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683266.262035:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe89a expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.262044:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe89a expref: 18 pid: 5821 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.262052:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876618815504896:0@lo:104: 00000100:00100000:2.0:1789683266.262113:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683266.262149:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe7cf expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.262157:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe7cf expref: 18 pid: 5822 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.262165:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876618815505024:0@lo:104: 00000100:00100000:2.0:1789683266.262189:0:8502:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683266.262211:0:8502:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe44431600/0x59bee33f93fe774 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fe76d expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.262219:0:8502:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe44431600/0x59bee33f93fe774 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fe76d expref: 18 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.262227:0:8502:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876618815505152:0@lo:104: 00000100:00100000:2.0:1789683266.262243:0:8502:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe481a2780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683266.262504:0:5813:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789683266.262522:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.262544:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815504896 00000100:00100000:0.0:1789683266.262552:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815504896 00000100:00100000:0.0:1789683266.262609:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815505024 00000100:00100000:0.0:1789683266.262613:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815505024 00000100:00100000:0.0:1789683266.262624:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815505152 00000100:00100000:0.0:1789683266.262626:0:5813:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815505152 00000100:00100000:0.0:1789683266.262637:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683266.262644:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+5:8502:x1876618815504896:12345-0@lo:104: 00010000:00010000:0.0:1789683266.262657:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.262722:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789683266.262728:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+5:8502:x1876618815504896:12345-0@lo:104: Request processed in 85us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.262734:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683266.262750:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683266.262756:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbd44c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+4:8502:x1876618815505024:12345-0@lo:104: 00010000:00010000:0.0:1789683266.262764:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.262798:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789683266.262803:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbd44c51c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+4:8502:x1876618815505024:12345-0@lo:104: Request processed in 48us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.262808:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789683266.262839:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683266.262845:0:5813:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:8502:x1876618815505152:12345-0@lo:104: 00010000:00010000:0.0:1789683266.262853:0:5813:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.262883:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789683266.262894:0:5813:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:08ddc492-5684-492d-ac6b-b8fd660301db+3:8502:x1876618815505152:12345-0@lo:104: Request processed in 49us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.262900:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789683266.262917:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789683266.262924:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.262930:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8ce00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683266.262934:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.262943:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683266.262950:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683266.262956:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789683266.262981:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.262987:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683266.263005:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263012:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ce00/0x59bee33f93fe89a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe8a1 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263024:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683266.263027:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263043:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2a00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683266.263046:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263052:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683266.263059:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683266.263064:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789683266.263090:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263097:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683266.263104:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263110:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2a00/0x59bee33f93fe7cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe7d6 expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263119:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683266.263121:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263127:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8ca00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683266.263130:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263146:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683266.263153:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683266.263158:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789683266.263171:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263177:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683266.263192:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263198:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8ca00/0x59bee33f93fe76d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fe774 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263210:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683266.263212:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683266.263214:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683266.263220:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683266.263225:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683266.263242:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815505280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683266.263271:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.263289:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683266.263294:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815505408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683266.263314:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.263336:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683266.263343:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815505536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683266.263370:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683266.263397:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815505280 00000100:00100000:0.0:1789683266.263401:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815505280 00010000:00010000:0.0:1789683266.263418:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe89a expref: 19 pid: 5821 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683266.263436:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815505408 00000100:00100000:0.0:1789683266.263438:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815505408 00010000:00010000:0.0:1789683266.263446:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe7cf expref: 20 pid: 5822 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683266.263454:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815505536 00000100:00100000:0.0:1789683266.263456:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815505536 00010000:00010000:0.0:1789683266.263464:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe44431600/0x59bee33f93fe774 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe76d expref: 21 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683266.263474:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683266.263479:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+21:3302:x1876618815505280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683266.263488:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683266.263492:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe89a expref: 21 pid: 5821 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263500:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe89a expref: 21 pid: 5821 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263513:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683266.263537:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+21:3302:x1876618815505280:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.263543:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683266.263556:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683266.263569:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+20:3302:x1876618815505408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683266.263576:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683266.263580:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe7cf expref: 20 pid: 5822 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263588:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe7cf expref: 20 pid: 5822 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263598:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683266.263618:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+20:3302:x1876618815505408:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.263624:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683266.263638:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683266.263643:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815505536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683266.263650:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683266.263653:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe44431600/0x59bee33f93fe774 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fe76d expref: 19 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263661:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe44431600/0x59bee33f93fe774 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fe76d expref: 19 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.263669:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683266.263721:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815505536:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683266.263726:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683266.263757:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815505536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683266.263779:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815505408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683266.263786:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815505280:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683266.268577:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9e00/0x59bee33f93fe8a1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe89a expref: 18 pid: 5821 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.268857:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876618815504896:0@lo:104: 00010000:00010000:2.0:1789683266.268873:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe44430600/0x59bee33f93fe7d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe7cf expref: 17 pid: 5822 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.268883:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876618815505024:0@lo:104: 00010000:00010000:2.0:1789683266.268893:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe44431600/0x59bee33f93fe774 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fe76d expref: 16 pid: 5823 timeout: 349 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683266.268901:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876618815505152:0@lo:104: 00000100:00100000:0.0:1789683266.279669:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683266.279831:0:8502:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8502:1876618815504768:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683266.279872:0:8502:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683266.279956:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802894976 00000100:00100000:1.0:1789683266.279965:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802894976 00010000:00010000:1.0:1789683266.280005:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efef4 expref: 10 pid: 5821 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683266.280042:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:1.0:1789683266.280051:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85ca73fa-7ddf-4820-b817-0961de675c61+10:2353:x1876618802894976:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683266.280065:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683266.280070:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efef4 expref: 10 pid: 5821 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280094:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efef4 expref: 10 pid: 5821 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280113:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e3600/0x59bee33f93fe95e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efef4 expref: 10 pid: 5821 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280130:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280140:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280156:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280178:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280185:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280193:0:7627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280211:0:7627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8da00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683266.280216:0:7627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280224:0:7627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280243:0:7627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683266.280253:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683266.280322:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:85ca73fa-7ddf-4820-b817-0961de675c61+9:2353:x1876618802894976:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 272us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683266.280332:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00010000:00010000:2.0:1789683266.280468:0:8502:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.280475:0:8502:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683266.280482:0:8502:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8da00/0x59bee33f93fe9ff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8502 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683266.911808:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683267.937746:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683268.011203:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 10000000:01000000:1.0:1789683268.011345:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789683268.011349:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe53b2b800 from 4 10000000:01000000:1.0:1789683268.011353:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683268.011392:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683268.011403:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683268.011421:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683268.011443:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815505664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683268.011486:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683268.011532:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4764e300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683268.013495:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802895104 00000100:00100000:3.0:1789683268.013506:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802895104 00000100:00100000:3.0:1789683268.013556:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815505664 00000100:00100000:3.0:1789683268.013559:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815505664 00000100:00100000:3.0:1789683268.013575:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:3.0:1789683268.013584:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+9:5588:x1876618802895104:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683268.013600:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683268.013616:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449eff33 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683268.013649:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff33 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683268.013660:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff33 expref: 10 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683268.013669:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9200, rc 0) 00000100:00100000:3.0:1789683268.013737:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:5588:x1876618802895104:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 154us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683268.013744:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:3.0:1789683268.013767:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789683268.013771:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815505664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683268.013778:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683268.013785:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fea06 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683268.013799:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fea06 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683268.013808:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea06 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683268.013813:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8400, rc 0) 00000100:00100000:3.0:1789683268.013857:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815505664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (2370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683268.013862:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1789683268.014012:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815505664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683268.019639:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683268.019658:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683268.019760:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815505792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683268.019817:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683268.019857:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815505792 00000100:00100000:3.0:1789683268.019863:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815505792 00000100:00100000:3.0:1789683268.019903:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789683268.019912:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815505792:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683268.020396:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683268.020446:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802895232 00000100:00100000:2.0:1789683268.020450:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802895232 00000100:00100000:2.0:1789683268.020468:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:2.0:1789683268.020475:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:5588:x1876618802895232:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.023105:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b3b000 going to sleep for 11 seconds 00000100:00100000:3.0:1789683268.027867:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815505792:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 7948us (8041us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683268.027880:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789683268.028893:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815505792:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683268.028945:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815505920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683268.028998:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683268.029041:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4764eb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789683268.029475:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:5588:x1876618802895232:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 8997us (9078us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.029500:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:2.0:1789683268.029524:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815505920 00000100:00100000:2.0:1789683268.029529:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815505920 00000100:00100000:2.0:1789683268.029557:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789683268.029563:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815505920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.029723:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815505920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.029729:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789683268.031181:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815505920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683268.038938:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8549:1876618815506048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683268.039013:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683268.039154:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815506048 00000100:00100000:2.0:1789683268.039161:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815506048 00000100:00100000:2.0:1789683268.039198:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1789683268.039206:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:8549:x1876618815506048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683268.039380:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:8549:x1876618815506048:12345-0@lo:502:llog_process_th.0 Request processed in 174us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.039388:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1789683268.040606:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52d41cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683268.040631:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8549:1876618815506048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683268.040662:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683268.040690:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683268.040693:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789683268.040699:0:8549:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe53b2b800 00000020:00000080:3.0:1789683268.040702:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789683268.040774:0:8549:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8549:1876618815506176:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683268.040819:0:8549:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683268.040848:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815506176 00000100:00100000:3.0:1789683268.040852:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815506176 00000100:00100000:3.0:1789683268.040881:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789683268.040888:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:8549:x1876618815506176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683268.042581:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:8549:x1876618815506176:12345-0@lo:502:llog_process_th.0 Request processed in 1688us (1756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683268.042592:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1789683268.042657:0:8549:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e93b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683268.042690:0:8549:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8549:1876618815506176:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683268.042716:0:8549:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683268.042722:0:8549:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683268.042724:0:8549:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1789683268.042727:0:8549:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789683268.043807:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789683268.043827:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789683268.043836:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683268.043848:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683268.043857:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789683268.043860:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe52f3c000 from 4 10000000:01000000:0.0:1789683268.043862:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683268.043890:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683268.043899:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683268.043908:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683268.043927:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815506304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683268.043972:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683268.043997:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683268.044668:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815506304 00000100:00100000:2.0:1789683268.044738:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815506304 00000100:00100000:2.0:1789683268.044784:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789683268.044793:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815506304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683268.044808:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683268.044820:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fea1b expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683268.044856:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fea1b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683268.044867:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea1b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683268.044875:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c800, rc 0) 00000100:00100000:2.0:1789683268.044925:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815506304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.044943:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1789683268.044985:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815506304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683268.045000:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683268.045008:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683268.045293:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815506432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.045323:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683268.045348:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815506432 00000100:00100000:2.0:1789683268.045352:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815506432 00000100:00100000:2.0:1789683268.045374:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789683268.045381:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815506432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.047190:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815506432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1805us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.047201:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789683268.047263:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969000 going to sleep for 11 seconds 00000100:00100000:2.0:1789683268.047283:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815506432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.047326:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815506560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.047367:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683268.047391:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969000 going to sleep for 11 seconds 00000100:00100000:3.0:1789683268.050623:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683268.050654:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815506560 00000100:00100000:3.0:1789683268.050664:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815506560 00000100:00100000:3.0:1789683268.050721:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802895360 00000100:00100000:3.0:1789683268.050723:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802895360 00000100:00100000:3.0:1789683268.050735:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789683268.050743:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815506560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683268.050930:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815506560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (3561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683268.050937:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1789683268.050970:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:3.0:1789683268.050976:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:5588:x1876618802895360:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683268.051073:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:5588:x1876618802895360:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 86us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683268.051090:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:3.0:1789683268.051137:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815506560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683268.064575:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8553:1876618815506688:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683268.064659:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683268.064716:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815506688 00000100:00100000:1.0:1789683268.064722:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815506688 00000100:00100000:1.0:1789683268.064758:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789683268.064765:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:8553:x1876618815506688:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683268.064971:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:8553:x1876618815506688:12345-0@lo:502:llog_process_th.0 Request processed in 204us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683268.064979:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789683268.065040:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe70c613c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683268.065071:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8553:1876618815506688:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683268.065107:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683268.065116:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683268.065119:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789683268.065126:0:8553:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe52f3c000 00000020:00000080:1.0:1789683268.065129:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789683268.065546:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8553:1876618815506816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683268.065579:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683268.065602:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe46e80e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683268.065969:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683268.065981:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815506944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683268.066012:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683268.069360:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815506944 00000100:00100000:1.0:1789683268.069372:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815506944 00000100:00100000:1.0:1789683268.069423:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683268.069432:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815506944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683268.069464:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683268.069544:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815506944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (3530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683268.069551:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789683268.069617:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe5309b800 x1876618815506944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683284 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683268.069637:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815506944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683268.070234:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815506816 00000100:00100000:0.0:1789683268.070240:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815506816 00000100:00100000:0.0:1789683268.070266:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789683268.070272:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:8553:x1876618815506816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683268.070440:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:8553:x1876618815506816:12345-0@lo:502:llog_process_th.0 Request processed in 168us (4860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683268.070447:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789683268.071483:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00080000:2.0:1789683268.071517:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683268.071593:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802895488 00000100:00100000:2.0:1789683268.071598:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802895488 00000100:00100000:2.0:1789683268.071628:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:2.0:1789683268.071636:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:6119:x1876618802895488:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683268.071830:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:6119:x1876618802895488:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 193us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.071837:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:2.0:1789683268.071870:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815507072:0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.071904:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683268.071935:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683268.071941:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815507200:0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.071962:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683268.071987:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815507456:0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.072004:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683268.072019:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683268.072033:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815507328:0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.072054:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683268.072161:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815507072 00000100:00100000:2.0:1789683268.072170:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815507072 00000100:00100000:2.0:1789683268.072192:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815507200 00000100:00100000:2.0:1789683268.072194:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815507200 00000100:00100000:2.0:1789683268.072207:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815507456 00000100:00100000:2.0:1789683268.072209:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815507456 00000100:00100000:2.0:1789683268.072221:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683268.072225:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815507072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.072258:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815507072:12345-0@lo:400:kworker.0 Request processed in 32us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.072264:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683268.072275:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683268.072279:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815507200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.072300:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815507200:12345-0@lo:400:kworker.0 Request processed in 21us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.072304:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683268.072313:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683268.072318:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815507456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.072342:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815507456:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.072347:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683268.072366:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815507328 00000100:00100000:2.0:1789683268.072369:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815507328 00000100:00100000:2.0:1789683268.072390:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789683268.072395:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815507328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.072419:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815507328:12345-0@lo:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.072424:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789683268.072446:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683268.072449:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789683268.072472:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7b94b480 x1876618815507328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683268.072485:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815507328:0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.072493:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815507456:0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.072515:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815507200:0@lo:400:kworker.0 00000100:00100000:2.0:1789683268.072522:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815507072:0@lo:400:kworker.0 00000100:00100000:1.0:1789683268.073213:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8553:1876618815506816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683268.073242:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683268.073249:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683268.073251:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789683268.073255:0:8553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789683268.073827:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789683268.073845:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789683268.073854:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683268.073866:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683268.073876:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789683268.073878:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe46fc8800 from 4 10000000:01000000:0.0:1789683268.073881:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683268.073909:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683268.073917:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683268.073926:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683268.073942:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815507584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683268.073984:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683268.074018:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683268.074110:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815507584 00000100:00100000:2.0:1789683268.074115:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815507584 00000100:00100000:2.0:1789683268.074150:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789683268.074159:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815507584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683268.074170:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683268.074181:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fea29 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683268.074203:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fea29 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683268.074212:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea29 expref: 19 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683268.074221:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d000, rc 0) 00000100:00100000:2.0:1789683268.074253:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815507584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.074259:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789683268.074296:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815507584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683268.074308:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683268.074317:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683268.074355:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815507712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.074380:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683268.074392:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe49664900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683268.074402:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815507712 00000100:00100000:2.0:1789683268.074404:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815507712 00000100:00100000:2.0:1789683268.074421:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789683268.074426:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815507712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.074616:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815507712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 189us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.074623:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1789683268.074646:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815507712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.074667:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815507840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.074722:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683268.074733:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe49664900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683268.074742:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815507840 00000100:00100000:2.0:1789683268.074745:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815507840 00000100:00100000:2.0:1789683268.074758:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789683268.074763:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815507840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683268.074872:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815507840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.074883:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789683268.074911:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815507840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683268.076448:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8556:1876618815507968:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683268.076623:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683268.076690:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe46e80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683268.076847:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815507968 00000100:00100000:0.0:1789683268.076855:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815507968 00000100:00100000:0.0:1789683268.076885:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1789683268.076893:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:8556:x1876618815507968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683268.077657:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:8556:x1876618815507968:12345-0@lo:502:llog_process_th.0 Request processed in 762us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683268.077665:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1789683268.085570:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8556:1876618815507968:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683268.085609:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683268.085617:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683268.085620:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789683268.085626:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe46fc8800 00000020:00000080:1.0:1789683268.085629:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789683268.085997:0:8556:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8556:1876618815508096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683268.086089:0:8556:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683268.086133:0:8556:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe46e80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683268.086318:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815508096 00000100:00100000:0.0:1789683268.086325:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815508096 00000100:00100000:0.0:1789683268.086364:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1789683268.086371:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:8556:x1876618815508096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683268.086585:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:8556:x1876618815508096:12345-0@lo:502:llog_process_th.0 Request processed in 214us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683268.086594:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789683268.087213:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683268.087390:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802895616 00000100:00100000:2.0:1789683268.087396:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802895616 00000100:00100000:2.0:1789683268.087426:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:2.0:1789683268.087434:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:6119:x1876618802895616:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683268.087572:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:6119:x1876618802895616:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 138us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683268.087579:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:1.0:1789683268.088713:0:8556:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:8556:1876618815508096:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789683268.088743:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683268.088750:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683268.088753:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789683268.088757:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789683268.088981:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789683268.089001:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683268.089010:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683268.089022:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683268.962255:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683269.826079:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683269.826117:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802895744 00000100:00100000:3.0:1789683269.826123:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683269.826129:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802895744 00000100:00100000:3.0:1789683269.826151:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683269.826183:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:2.0:1789683269.826193:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:2352:x1876618802895744:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683269.826255:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:2352:x1876618802895744:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 63us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683269.826262:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:3.0:1789683269.830772:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683269.832226:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802895872 00000100:00100000:3.0:1789683269.832237:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802895872 00000100:00100000:3.0:1789683269.832330:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1789683269.832341:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802895872:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683269.832421:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802895872:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 81us (6268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683269.832429:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1789683269.833502:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802896000 00000100:00100000:1.0:1789683269.833510:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802896000 00000100:00100000:1.0:1789683269.833548:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802896128 00000100:00100000:1.0:1789683269.833552:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802896128 00000100:00100000:1.0:1789683269.833577:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1789683269.833585:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2352:x1876618802896000:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683269.833633:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2352:x1876618802896000:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 49us (7512us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683269.833639:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1789683269.833653:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1789683269.833660:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2352:x1876618802896128:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683269.833707:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2352:x1876618802896128:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (2951us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683269.833722:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00080000:0.0:1789683269.833806:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683269.833811:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683269.833814:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789683269.984101:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683271.008757:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683271.137547:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683271.137568:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815508224:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683271.137635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683271.137874:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815508224 00000100:00100000:1.0:1789683271.137882:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815508224 00000100:00100000:1.0:1789683271.137946:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789683271.137956:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815508224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683271.137990:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683271.138049:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815508224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683271.138056:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789683271.138093:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d01c00 x1876618815508224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683287 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683271.138109:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815508224:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683271.138962:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683272.035158:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683273.064776:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683273.185191:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815508352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683273.185263:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683273.185349:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815508352 00000100:00100000:2.0:1789683273.185357:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815508352 00000100:00100000:2.0:1789683273.185404:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789683273.185413:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815508352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683273.185442:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683273.185484:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815508352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683273.185491:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1789683273.185528:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7b94b100 x1876618815508352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683289 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683273.185546:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815508352:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789683273.185835:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683273.186832:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815508480:0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.186872:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683273.186897:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815508992:0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.187705:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683273.187750:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683273.187759:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815508608:0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.187783:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683273.187820:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815508480 00000100:00100000:2.0:1789683273.187825:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815508480 00000100:00100000:0.0:1789683273.187862:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815508992 00000100:00100000:2.0:1789683273.187872:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789683273.187878:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815508992 00000100:00100000:2.0:1789683273.187885:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815508480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683273.187941:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815508608 00000100:00100000:0.0:1789683273.187946:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815508608 00000100:00100000:0.0:1789683273.187968:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789683273.187977:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815508992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.188010:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815508480:12345-0@lo:400:kworker.0 Request processed in 125us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683273.188030:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789683273.188071:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683273.188082:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815508608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683273.188107:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815508992:12345-0@lo:400:kworker.0 Request processed in 128us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683273.188117:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789683273.188146:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815508608:12345-0@lo:400:kworker.0 Request processed in 61us (355us total) trans 0 rc 0/0 00000100:00080000:0.0:1789683273.188163:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683273.188704:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683273.188746:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815508736:0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.188780:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683273.188810:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683273.188817:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815508864:0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.188841:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683273.188891:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815508864 00000100:00100000:2.0:1789683273.188896:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815508864 00000100:00100000:2.0:1789683273.193263:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789683273.193279:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815508864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.193365:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815508864:12345-0@lo:400:kworker.0 Request processed in 92us (4523us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683273.193372:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789683273.193426:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d01f80 x1876618815508864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683273.193442:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815508864:0@lo:400:kworker.0 00000100:00080000:1.0:1789683273.193448:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683273.193490:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815508608:0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.193518:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815508480:0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.193529:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815508992:0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.193560:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815508736 00000100:00100000:2.0:1789683273.193566:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815508736 00000100:00100000:2.0:1789683273.193620:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683273.193629:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815508736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683273.193696:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815508736:12345-0@lo:400:kworker.0 Request processed in 68us (4914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683273.193704:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789683273.193745:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815508736:0@lo:400:kworker.0 00000100:00080000:1.0:1789683273.193815:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789683274.084624:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683274.945244:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683274.945301:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683274.945406:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802896384 00000100:00100000:1.0:1789683274.945432:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802896384 00000100:00100000:1.0:1789683274.945529:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1789683274.945542:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802896384:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683274.945649:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802896384:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 110us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683274.945658:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00080000:0.0:1789683274.945892:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683274.945985:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802896256 00000100:00100000:3.0:1789683274.946066:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802896256 00000100:00100000:3.0:1789683274.946148:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:3.0:1789683274.946157:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2354:x1876618802896256:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683274.946206:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2354:x1876618802896256:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 50us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683274.946213:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:0.0:1789683274.954926:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683274.955125:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683274.955164:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802896512 00000100:00100000:0.0:1789683274.955176:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802896512 00000100:00100000:0.0:1789683274.955251:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802896640 00000100:00100000:0.0:1789683274.955254:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802896640 00000100:00100000:0.0:1789683274.955282:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1789683274.955295:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2351:x1876618802896512:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1789683274.955350:0:8465:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe96c 00000100:00080000:0.0:1789683274.955364:0:8465:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9ea000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683274.955412:0:8465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789683274.955614:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1789683274.955625:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2351:x1876618802896640:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:3.0:1789683274.955699:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe973 00000100:00080000:3.0:1789683274.955706:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9ec000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683274.955747:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789683274.956411:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+2:2351:x1876618802896640:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 786us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683274.958905:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00010000:00010000:3.0:1789683274.959916:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683274.961820:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+2:2351:x1876618802896512:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 4425us (4809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683274.961841:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00010000:00010000:0.0:1789683274.964104:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789683274.964122:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683274.964131:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789683275.107835:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683276.131493:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683276.256887:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815509120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683276.257011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683276.257141:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815509120 00000100:00100000:1.0:1789683276.257151:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815509120 00000100:00100000:1.0:1789683276.257226:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683276.257237:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815509120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683276.257281:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683276.257332:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815509120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683276.257349:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1789683276.257408:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d01500 x1876618815509120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683292 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683276.257427:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815509120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789683276.257470:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683277.164275:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683277.702627:0:8800:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:2.0:1789683278.177563:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683278.309212:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815509376:0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.309314:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683278.309370:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815509888:0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.309395:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683278.309427:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789683278.309434:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815509248:0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.309459:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683278.309479:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815509760:0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.309498:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683278.309536:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815509376 00000100:00100000:0.0:1789683278.309545:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815509376 00000100:00100000:0.0:1789683278.309587:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815509760 00000100:00100000:0.0:1789683278.309589:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815509760 00000100:00100000:0.0:1789683278.309615:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683278.309624:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815509376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.309711:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815509376:12345-0@lo:400:kworker.0 Request processed in 87us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683278.309718:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683278.309737:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789683278.309743:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815509760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.309769:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815509760:12345-0@lo:400:kworker.0 Request processed in 27us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683278.309774:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789683278.309792:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815509888 00000100:00100000:0.0:1789683278.309795:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815509888 00000100:00100000:0.0:1789683278.309819:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683278.309826:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815509888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.309867:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815509888:12345-0@lo:400:kworker.0 Request processed in 42us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683278.309874:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683278.309892:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815509248 00000100:00100000:0.0:1789683278.309896:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815509248 00000100:00100000:0.0:1789683278.309918:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789683278.309925:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815509248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.309954:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815509248:12345-0@lo:400:kworker.0 Request processed in 30us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683278.309960:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789683278.310017:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815509248:0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.310031:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815509760:0@lo:400:kworker.0 00000100:00100000:0.0:1789683278.310040:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815509376:0@lo:400:kworker.0 00010000:00080000:0.0:1789683278.310051:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6aad80 x1876618815509888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683278.310063:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815509888:0@lo:400:kworker.0 00000100:00100000:1.0:1789683278.310254:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815509504:0@lo:400:kworker.0 00000100:00100000:1.0:1789683278.310285:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683278.310310:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683278.310316:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815509632:0@lo:400:kworker.0 00000100:00100000:1.0:1789683278.310338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683278.310369:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815509504 00000100:00100000:1.0:1789683278.310372:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815509504 00000100:00100000:1.0:1789683278.310400:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789683278.310407:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815509504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683278.310442:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815509504:12345-0@lo:400:kworker.0 Request processed in 37us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683278.310448:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1789683278.310465:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683278.310478:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683278.310492:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815509632 00000100:00100000:1.0:1789683278.310496:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815509632 00000100:00100000:1.0:1789683278.310522:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789683278.310528:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815509632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683278.310557:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815509632:12345-0@lo:400:kworker.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683278.310563:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:1.0:1789683278.311608:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683278.311639:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7d6ab100 x1876618815509632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683278.311653:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815509632:0@lo:400:kworker.0 00000100:00100000:1.0:1789683278.311665:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815509504:0@lo:400:kworker.0 00000100:00100000:1.0:1789683278.318304:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683278.318333:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815510016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683278.318419:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683278.318471:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815510016 00000100:00100000:1.0:1789683278.318480:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815510016 00000100:00100000:1.0:1789683278.318531:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683278.318541:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815510016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683278.318584:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683278.318627:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815510016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683278.318635:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789683278.318697:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d03b80 x1876618815510016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683294 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683278.318742:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815510016:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1789683278.542717:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:1.0:1789683278.542732:0:7641:0:(genops.c:885:class_export_put()) final put ffff8dbe4e9ec800/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:1.0:1789683278.542768:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe4e9ec800/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 for lustre-OST0001 00000020:00000080:1.0:1789683278.542818:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe4e9ec000 for lustre-OST0001 00000001:00100000:0.0:1789683278.784663:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:0.0:1789683278.784693:0:6700:0:(genops.c:885:class_export_put()) final put ffff8dbe4e9eb800/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:0.0:1789683278.801614:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe4e9eb800/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 for lustre-OST0000 00000020:00000080:0.0:1789683278.802072:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe4e9ea000 for lustre-OST0000 00010000:00010000:2.0:1789683279.203861:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683280.043628:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683280.043915:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802896896 00000100:00100000:2.0:1789683280.043925:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802896896 00000100:00100000:2.0:1789683280.044020:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1789683280.044031:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802896896:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683280.044105:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802896896:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 76us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683280.044112:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00080000:3.0:1789683280.044310:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683280.048415:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683280.053046:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802896768 00000100:00100000:3.0:1789683280.053060:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802896768 00000100:00100000:3.0:1789683280.053123:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:3.0:1789683280.053134:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802896768:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683280.053277:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802896768:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 145us (4932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683280.053285:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 195 00010000:00010000:0.0:1789683280.226645:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683281.248256:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683281.376919:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815510144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683281.377033:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683281.377296:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815510144 00000100:00100000:1.0:1789683281.377307:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815510144 00000100:00100000:1.0:1789683281.377394:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683281.377406:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815510144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683281.377473:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683281.377539:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815510144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683281.377547:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1789683281.377600:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d02d80 x1876618815510144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683297 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683281.377630:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815510144:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789683281.377888:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683282.272097:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683283.297397:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683283.425999:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815510656:0@lo:400:kworker.0 00000100:00100000:2.0:1789683283.426070:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683283.426138:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683283.426145:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815510528:0@lo:400:kworker.0 00000100:00100000:2.0:1789683283.426173:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683283.426204:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815510528 00000100:00100000:2.0:1789683283.426212:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815510528 00000100:00100000:0.0:1789683283.426385:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815510272:0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.426431:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683283.426461:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815510784:0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.426480:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683283.426497:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789683283.426501:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815510400:0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.426517:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683283.426528:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815510912:0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.426543:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683283.426568:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815510656 00000100:00100000:0.0:1789683283.426571:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815510656 00000100:00100000:0.0:1789683283.426598:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815510912 00000100:00100000:0.0:1789683283.426601:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815510912 00000100:00100000:0.0:1789683283.426630:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683283.426639:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815510656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.426704:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815510656:12345-0@lo:400:kworker.0 Request processed in 65us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683283.426710:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683283.426725:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683283.426730:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815510912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.426758:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815510912:12345-0@lo:400:kworker.0 Request processed in 29us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683283.426764:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683283.426778:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815510784 00000100:00100000:0.0:1789683283.426781:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815510784 00000100:00100000:0.0:1789683283.426795:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815510400 00000100:00100000:0.0:1789683283.426797:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815510400 00000100:00100000:0.0:1789683283.426806:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683283.426812:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815510528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.426848:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815510528:12345-0@lo:400:kworker.0 Request processed in 36us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683283.426854:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683283.426866:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683283.426871:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815510784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.426891:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815510784:12345-0@lo:400:kworker.0 Request processed in 21us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683283.426896:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683283.426917:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789683283.426922:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815510400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.426956:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815510400:12345-0@lo:400:kworker.0 Request processed in 23us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683283.426962:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789683283.426979:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815510272 00000100:00100000:0.0:1789683283.426982:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815510272 00000100:00100000:0.0:1789683283.427001:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789683283.427006:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815510272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.427031:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815510272:12345-0@lo:400:kworker.0 Request processed in 25us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683283.427036:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1789683283.427091:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd98700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815510400:0@lo:400:kworker.0 00010000:00080000:0.0:1789683283.427103:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe485da300 x1876618815510912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683283.427113:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815510912:0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.427131:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815510272:0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.427141:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815510784:0@lo:400:kworker.0 00000100:00100000:0.0:1789683283.427168:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815510528:0@lo:400:kworker.0 00010000:00080000:0.0:1789683283.427178:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7bd9a680 x1876618815510656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683299 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683283.427186:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815510656:0@lo:400:kworker.0 00000100:00080000:3.0:1789683283.427724:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683283.427729:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683283.427732:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683283.433412:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815511040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683283.433483:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683283.433535:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815511040 00000100:00100000:3.0:1789683283.433542:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815511040 00000100:00100000:3.0:1789683283.433586:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789683283.433595:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815511040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683283.433628:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683283.433696:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815511040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683283.433703:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1789683283.433748:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d02d80 x1876618815511040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683299 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683283.433767:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815511040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789683284.326713:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683285.157482:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683285.157575:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683285.160605:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802897152 00000100:00100000:0.0:1789683285.160619:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802897152 00000100:00100000:0.0:1789683285.160730:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1789683285.160742:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802897152:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683285.160839:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d02d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802897152:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 101us (3264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683285.160846:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00080000:0.0:1789683285.160868:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683285.172990:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802897024 00000100:00100000:3.0:1789683285.173010:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802897024 00000100:00100000:0.0:1789683285.174968:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:0.0:1789683285.174981:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:2352:x1876618802897024:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683285.175063:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:2352:x1876618802897024:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 85us (17590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683285.175070:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 197 00010000:00010000:2.0:1789683285.351081:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683286.373582:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683286.495798:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815511168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683286.495865:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683286.499275:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815511168 00000100:00100000:2.0:1789683286.499290:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815511168 00000100:00100000:2.0:1789683286.499376:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789683286.499386:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815511168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683286.499437:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789683286.499550:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683286.513047:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815511168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 13653us (17172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683286.513062:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1789683286.517654:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d01180 x1876618815511168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683302 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683286.517727:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815511168:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683287.392012:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789683288.315952:0:9048:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing yml_node 00000100:00100000:3.0:1789683288.545082:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815511296:0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.545157:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683288.545208:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815511808:0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.545243:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683288.545244:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815511680:0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.545271:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789683288.545280:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815511424:0@lo:400:kworker.0 00000100:00100000:2.0:1789683288.545294:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683288.545312:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683288.545320:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683288.545328:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815511552:0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.545340:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815511936:0@lo:400:kworker.0 00000100:00100000:2.0:1789683288.545352:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683288.545373:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683288.545410:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815511296 00000100:00100000:3.0:1789683288.545418:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815511296 00000100:00100000:3.0:1789683288.545461:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789683288.545471:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815511296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.545531:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815511296:12345-0@lo:400:kworker.0 Request processed in 62us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683288.545539:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1789683288.545569:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815511808 00000100:00100000:3.0:1789683288.545584:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815511808 00000100:00100000:3.0:1789683288.545618:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815511424 00000100:00100000:3.0:1789683288.545621:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815511424 00000100:00100000:1.0:1789683288.546023:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815512064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683288.546057:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789683288.546083:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683288.546093:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815512064 00000100:00100000:1.0:1789683288.546097:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815512064 00000100:00100000:1.0:1789683288.546126:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789683288.546132:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815512064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683288.546156:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683288.546190:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815512064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683288.546197:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789683288.546209:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815511552 00000100:00100000:3.0:1789683288.546214:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815511552 00000100:00080000:1.0:1789683288.546231:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683288.546236:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683288.546239:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683288.546247:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815511808:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1789683288.546260:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d02680 x1876618815512064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683304 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683288.546280:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815512064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683288.546287:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815511808:12345-0@lo:400:kworker.0 Request processed in 39us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683288.546294:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683288.546309:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683288.546314:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815511424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.546338:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815511424:12345-0@lo:400:kworker.0 Request processed in 25us (1029us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683288.546344:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683288.546355:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789683288.546361:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815511552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.546386:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815511552:12345-0@lo:400:kworker.0 Request processed in 25us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683288.546392:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:0.0:1789683288.559962:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683288.560131:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815511680 00000100:00100000:2.0:1789683288.560142:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815511680 00000100:00100000:2.0:1789683288.560195:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815511936 00000100:00100000:2.0:1789683288.560200:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815511936 00000100:00100000:3.0:1789683288.562328:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683288.562464:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815511424:0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.562477:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815511296:0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.564083:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815511808:0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.564132:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815511680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683288.564235:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815511680:12345-0@lo:400:kworker.0 Request processed in 1895us (18940us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683288.564243:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683288.566336:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815511552:0@lo:400:kworker.0 00010000:00080000:0.0:1789683288.566354:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe53099c00 x1876618815511680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683288.566365:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815511680:0@lo:400:kworker.0 00000100:00100000:2.0:1789683288.567352:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683288.567364:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815511936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683288.567461:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815511936:12345-0@lo:400:kworker.0 Request processed in 100us (22088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683288.567469:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1789683288.567514:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe53099f80 x1876618815511936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683288.567526:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815511936:0@lo:400:kworker.0 00000100:00080000:2.0:1789683288.567559:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683289.570243:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683290.306754:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683290.306794:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683290.306884:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802897408 00000100:00100000:3.0:1789683290.306906:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802897408 00000100:00100000:3.0:1789683290.306969:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:3.0:1789683290.306979:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802897408:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683290.307043:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802897408:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683290.307050:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00080000:1.0:1789683290.307764:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683290.316036:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802897280 00000100:00100000:2.0:1789683290.316050:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802897280 00000100:00100000:2.0:1789683290.316148:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:2.0:1789683290.316158:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802897280:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683290.316251:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802897280:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 95us (9456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683290.316259:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 199 00010000:00010000:2.0:1789683290.604718:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683291.633627:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683291.633646:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815512192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683291.633727:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683291.633793:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815512192 00000100:00100000:2.0:1789683291.633800:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815512192 00000100:00100000:2.0:1789683291.633864:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683291.633873:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815512192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683291.633915:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683291.633952:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815512192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683291.633959:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789683291.633977:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683291.634002:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe485d9c00 x1876618815512192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683291.634035:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815512192:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789683291.651033:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683292.704033:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683293.665069:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815512576:0@lo:400:kworker.0 00000100:00100000:2.0:1789683293.665138:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683293.665191:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683293.665197:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815512704:0@lo:400:kworker.0 00000100:00100000:2.0:1789683293.665221:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683293.666961:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815512320:0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683293.667069:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815512832:0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667095:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683293.667121:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789683293.667127:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815512448:0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667146:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683293.667162:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815512960:0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667183:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683293.667214:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815512704 00000100:00100000:3.0:1789683293.667220:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815512704 00000100:00100000:3.0:1789683293.667270:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815512960 00000100:00100000:3.0:1789683293.667273:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815512960 00000100:00100000:3.0:1789683293.667293:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683293.667301:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815512704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667352:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815512704:12345-0@lo:400:kworker.0 Request processed in 51us (2129us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683293.667373:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683293.667390:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683293.667396:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815512960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667434:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815512960:12345-0@lo:400:kworker.0 Request processed in 38us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683293.667439:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683293.667457:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815512576 00000100:00100000:3.0:1789683293.667460:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815512576 00000100:00100000:3.0:1789683293.667483:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815512832 00000100:00100000:3.0:1789683293.667486:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815512832 00000100:00100000:3.0:1789683293.667497:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815512448 00000100:00100000:3.0:1789683293.667499:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815512448 00000100:00100000:3.0:1789683293.667511:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683293.667516:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815512576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667546:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815512576:12345-0@lo:400:kworker.0 Request processed in 30us (2407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683293.667551:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683293.667562:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683293.667567:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815512832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667591:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815512832:12345-0@lo:400:kworker.0 Request processed in 24us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683293.667597:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683293.667608:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789683293.667613:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815512448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667640:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815512448:12345-0@lo:400:kworker.0 Request processed in 26us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683293.667655:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789683293.667724:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815512448:0@lo:400:kworker.0 00010000:00080000:3.0:1789683293.667735:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe485d8a80 x1876618815512960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683293.667744:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815512960:0@lo:400:kworker.0 00000100:00100000:3.0:1789683293.667752:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815512832:0@lo:400:kworker.0 00000100:00100000:2.0:1789683293.670649:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815512320 00000100:00100000:2.0:1789683293.670662:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815512320 00000100:00100000:2.0:1789683293.670755:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789683293.670764:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815512320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683293.670841:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815512320:12345-0@lo:400:kworker.0 Request processed in 77us (3818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683293.670848:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1789683293.670893:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683293.670899:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683293.670902:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683293.670938:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe485da680 x1876618815512704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683293.670953:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815512704:0@lo:400:kworker.0 00000100:00100000:2.0:1789683293.670965:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815512576:0@lo:400:kworker.0 00000100:00100000:0.0:1789683293.671319:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683293.671333:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815513088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683293.671372:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683293.671431:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815513088 00000100:00100000:0.0:1789683293.671436:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815513088 00000100:00100000:0.0:1789683293.671465:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683293.671472:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815513088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683293.671498:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683293.671931:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815513088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 458us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683293.671940:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789683293.673984:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815512320:0@lo:400:kworker.0 00010000:00080000:3.0:1789683293.674034:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d00380 x1876618815513088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683309 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683293.674054:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815513088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789683293.729289:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683294.751991:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683295.413668:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683295.413781:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683295.413918:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802897664 00000100:00100000:0.0:1789683295.413933:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802897664 00000100:00100000:0.0:1789683295.414016:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:0.0:1789683295.414030:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802897664:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683295.414131:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802897664:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 105us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683295.414139:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00080000:0.0:1789683295.414183:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683295.414244:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802897536 00000100:00100000:3.0:1789683295.414250:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802897536 00000100:00100000:3.0:1789683295.414289:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:3.0:1789683295.414297:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802897536:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683295.414328:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802897536:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 32us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683295.414334:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 201 00010000:00010000:2.0:1789683295.784952:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683296.616272:0:9241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.39 00000100:00100000:3.0:1789683296.737567:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815513216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683296.737656:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683296.740023:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815513216 00000100:00100000:3.0:1789683296.740061:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815513216 00000100:00100000:3.0:1789683296.740174:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683296.740186:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815513216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683296.740248:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683296.740366:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815513216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 181us (2710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683296.740374:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1789683296.740457:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe5309b800 x1876618815513216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683296.740486:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815513216:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789683296.756021:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683296.803256:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683297.824185:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683298.795298:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683298.795393:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815513344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683298.795595:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683298.797619:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815513344 00000100:00100000:3.0:1789683298.797634:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815513344 00000100:00100000:3.0:1789683298.797762:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789683298.797775:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815513344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683298.797846:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683298.798006:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815513344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 233us (2411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683298.798015:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789683298.798528:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683298.799390:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d01f80 x1876618815513344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683314 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683298.799423:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815513344:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683298.800363:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815513600:0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.800453:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683298.800498:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683298.808105:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815513728:0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.808248:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683298.808367:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815513600 00000100:00100000:2.0:1789683298.808379:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815513600 00000100:00100000:2.0:1789683298.808442:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815513728 00000100:00100000:2.0:1789683298.808445:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815513728 00000100:00100000:2.0:1789683298.808481:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789683298.808491:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815513600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.808560:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815513600:12345-0@lo:400:kworker.0 Request processed in 70us (8107us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683298.808568:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789683298.808589:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683298.808596:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815513728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.808625:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815513728:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683298.808631:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683298.808667:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815513856:0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.808892:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683298.808924:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789683298.808933:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815513472:0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.808966:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683298.809017:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815513984:0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.809041:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683298.810480:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815513856 00000100:00100000:2.0:1789683298.810495:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815513856 00000100:00100000:2.0:1789683298.810569:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683298.810580:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815513856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.810686:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815513856:12345-0@lo:400:kworker.0 Request processed in 93us (1778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683298.811461:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683298.811501:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815513472 00000100:00100000:2.0:1789683298.811507:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815513472 00000100:00100000:2.0:1789683298.811538:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789683298.811546:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815513472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.811588:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815513472:12345-0@lo:400:kworker.0 Request processed in 43us (2621us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683298.811594:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1789683298.811625:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815513984 00000100:00100000:2.0:1789683298.811629:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815513984 00000100:00100000:2.0:1789683298.811689:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789683298.812003:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815513984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.812040:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815513984:12345-0@lo:400:kworker.0 Request processed in 344us (2997us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683298.812047:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789683298.812094:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815513472:0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.812110:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815513984:0@lo:400:kworker.0 00010000:00080000:2.0:1789683298.812123:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe485dad80 x1876618815513856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683298.812147:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815513856:0@lo:400:kworker.0 00000100:00080000:2.0:1789683298.812175:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683298.812181:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683298.812199:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815513728:0@lo:400:kworker.0 00000100:00100000:2.0:1789683298.812210:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815513600:0@lo:400:kworker.0 00010000:00010000:1.0:1789683298.850997:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683299.880854:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683300.516200:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683300.516268:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683300.516388:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802897792 00000100:00100000:0.0:1789683300.516400:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802897792 00000100:00100000:0.0:1789683300.516480:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:0.0:1789683300.516493:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802897792:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683300.516606:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802897792:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 116us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683300.516615:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:2.0:1789683300.517046:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802897920 00000100:00100000:2.0:1789683300.517052:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802897920 00000100:00100000:2.0:1789683300.517120:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:2.0:1789683300.517129:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802897920:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683300.517185:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802897920:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 58us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683300.517193:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00080000:3.0:1789683300.517317:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789683300.896663:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683301.858402:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815514112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683301.858502:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683301.858907:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815514112 00000100:00100000:3.0:1789683301.858920:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815514112 00000100:00100000:3.0:1789683301.858991:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789683301.859005:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815514112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683301.859053:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683301.859117:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815514112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683301.859123:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789683301.859883:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683301.859942:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c432d80 x1876618815514112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683301.859968:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815514112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683301.930538:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683302.949907:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789683303.504176:0:9339:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.39 00000100:00100000:1.0:1789683303.907196:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815514624:0@lo:400:kworker.0 00000100:00100000:1.0:1789683303.907264:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683303.907316:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789683303.907324:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815514240:0@lo:400:kworker.0 00000100:00100000:1.0:1789683303.907362:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683303.907382:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815514752:0@lo:400:kworker.0 00000100:00100000:1.0:1789683303.907403:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683303.907429:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815514624 00000100:00100000:1.0:1789683303.907435:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815514624 00000100:00100000:1.0:1789683303.907483:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789683303.907491:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815514624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683303.907537:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815514624:12345-0@lo:400:kworker.0 Request processed in 47us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683303.907543:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789683303.907561:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683303.907586:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d02300 x1876618815514624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683303.907600:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815514624:0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.907662:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815514368:0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.907717:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.907739:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815514880:0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.907772:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.907799:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683303.907806:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815514496:0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.907828:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683303.907857:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815514240 00000100:00100000:2.0:1789683303.907861:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815514240 00000100:00100000:2.0:1789683303.907887:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789683303.907893:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815514240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.907947:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815514240:12345-0@lo:400:kworker.0 Request processed in 53us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.907953:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789683303.907979:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815514752 00000100:00100000:2.0:1789683303.907983:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815514752 00000100:00100000:2.0:1789683303.908010:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815514368 00000100:00100000:2.0:1789683303.908013:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815514368 00000100:00100000:2.0:1789683303.908023:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815514496 00000100:00100000:2.0:1789683303.908025:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815514496 00000100:00100000:2.0:1789683303.908038:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789683303.908043:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815514752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.908075:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815514752:12345-0@lo:400:kworker.0 Request processed in 32us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.908082:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789683303.908094:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789683303.908099:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815514368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.908128:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815514368:12345-0@lo:400:kworker.0 Request processed in 30us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.908134:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789683303.908144:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789683303.908149:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815514496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.908173:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815514496:12345-0@lo:400:kworker.0 Request processed in 24us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.908179:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789683303.908194:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815514880 00000100:00100000:2.0:1789683303.908198:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815514880 00000100:00100000:2.0:1789683303.908218:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683303.908230:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815514880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.908258:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815514880:12345-0@lo:400:kworker.0 Request processed in 29us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683303.908263:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789683303.908294:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815514496:0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.908302:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815514368:0@lo:400:kworker.0 00010000:00080000:2.0:1789683303.908310:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d00700 x1876618815514880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683303.908318:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815514880:0@lo:400:kworker.0 00000100:00080000:2.0:1789683303.908345:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683303.908349:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683303.908359:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815514240:0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.908368:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815514752:0@lo:400:kworker.0 00000100:00100000:2.0:1789683303.910711:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815515008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683303.910782:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683303.930174:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815515008 00000100:00100000:3.0:1789683303.930188:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815515008 00000100:00100000:3.0:1789683303.930277:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789683303.930288:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815515008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683303.930325:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683303.930407:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815515008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (19625us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683303.930415:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789683303.930473:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d02300 x1876618815515008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683303.931599:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815515008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789683303.969445:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683305.001211:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683305.659501:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683305.659555:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683305.659651:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802898048 00000100:00100000:2.0:1789683305.659662:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802898048 00000100:00100000:2.0:1789683305.659756:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:2.0:1789683305.659767:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2354:x1876618802898048:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683305.660317:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2354:x1876618802898048:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 550us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683305.660326:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:0.0:1789683305.660472:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802898176 00000100:00100000:0.0:1789683305.660477:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802898176 00000100:00100000:0.0:1789683305.660536:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1789683305.660545:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802898176:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683305.660594:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802898176:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 51us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683305.660600:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00080000:2.0:1789683305.660758:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789683306.015791:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683306.988074:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683306.988095:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815515136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683306.988162:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683306.989962:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815515136 00000100:00100000:3.0:1789683306.989973:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815515136 00000100:00100000:3.0:1789683306.990043:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683306.990053:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815515136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683306.990091:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683306.990187:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815515136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (2024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683306.990194:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1789683306.990293:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c433100 x1876618815515136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683306.990314:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815515136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789683306.990377:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683307.040109:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683308.063799:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683308.514304:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.39 00000100:00100000:1.0:1789683309.024208:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815515520:0@lo:400:kworker.0 00000100:00100000:1.0:1789683309.024297:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683309.024372:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789683309.024379:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815515392:0@lo:400:kworker.0 00000100:00100000:1.0:1789683309.024552:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683309.024582:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815515904:0@lo:400:kworker.0 00000100:00100000:1.0:1789683309.024607:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683309.024644:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815515520 00000100:00100000:1.0:1789683309.024652:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815515520 00000100:00100000:1.0:1789683309.024720:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815515392 00000100:00100000:1.0:1789683309.024723:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815515392 00000100:00100000:1.0:1789683309.024744:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683309.024925:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815515264:0@lo:400:kworker.0 00000100:00100000:2.0:1789683309.024958:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683309.024984:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815515776:0@lo:400:kworker.0 00000100:00100000:2.0:1789683309.025003:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683309.025015:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683309.025020:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815515648:0@lo:400:kworker.0 00000100:00100000:2.0:1789683309.025039:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683309.025066:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815515776 00000100:00100000:2.0:1789683309.025070:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815515776 00000100:00100000:2.0:1789683309.025087:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789683309.025092:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815515392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683309.025138:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815515392:12345-0@lo:400:kworker.0 Request processed in 45us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683309.025145:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789683309.025159:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789683309.025165:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815515776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683309.025190:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815515776:12345-0@lo:400:kworker.0 Request processed in 25us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683309.025195:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789683309.025209:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683309.025218:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815515264 00000100:00100000:2.0:1789683309.025221:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815515264 00000100:00100000:2.0:1789683309.025240:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789683309.025244:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815515264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683309.025278:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815515264:12345-0@lo:400:kworker.0 Request processed in 33us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683309.025284:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789683309.025306:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815515904 00000100:00100000:2.0:1789683309.025309:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815515904 00000100:00100000:2.0:1789683309.025331:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815515648 00000100:00100000:2.0:1789683309.025334:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815515648 00000100:00100000:2.0:1789683309.025350:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683309.025355:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815515904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683309.025381:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815515904:12345-0@lo:400:kworker.0 Request processed in 26us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683309.025592:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789683309.025604:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683309.025610:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815515648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683309.025637:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815515648:12345-0@lo:400:kworker.0 Request processed in 28us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683309.025641:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789683309.025660:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683309.025662:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683309.026546:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815515520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683309.026600:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815515520:12345-0@lo:400:kworker.0 Request processed in 1847us (2302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683309.026607:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789683309.026694:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815515392:0@lo:400:kworker.0 00010000:00080000:1.0:1789683309.026708:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d00000 x1876618815515904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683309.026718:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815515904:0@lo:400:kworker.0 00000100:00100000:1.0:1789683309.026728:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815515520:0@lo:400:kworker.0 00000100:00100000:3.0:1789683309.027074:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683309.027085:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815516032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683309.027118:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683309.027150:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815516032 00000100:00100000:3.0:1789683309.027156:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815516032 00000100:00100000:3.0:1789683309.027189:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683309.027196:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815516032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683309.027221:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683309.027256:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815516032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683309.027262:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1789683309.028931:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76d00700 x1876618815515648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683309.028948:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815515648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683309.028960:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815515264:0@lo:400:kworker.0 00000100:00100000:1.0:1789683309.028970:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815515776:0@lo:400:kworker.0 00010000:00080000:2.0:1789683309.029359:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c432300 x1876618815516032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683325 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683309.029377:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815516032:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789683309.087851:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683310.112915:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683310.765182:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683310.765220:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683310.765250:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802898432 00000100:00100000:3.0:1789683310.765259:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802898432 00000100:00100000:3.0:1789683310.765315:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:3.0:1789683310.765325:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802898432:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683310.765392:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802898432:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 68us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683310.765413:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00080000:3.0:1789683310.765437:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683310.765617:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802898304 00000100:00100000:0.0:1789683310.765623:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802898304 00000100:00100000:0.0:1789683310.765654:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:0.0:1789683310.765661:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2352:x1876618802898304:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683310.765714:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2352:x1876618802898304:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 53us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683310.765720:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 207 00000001:02000400:1.0:1789683311.015498:0:9485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 17 18:15:09 EDT 2026 00010000:00010000:0.0:1789683311.136604:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683312.096868:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683312.096920:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815516160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683312.097011:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683312.098524:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815516160 00000100:00100000:2.0:1789683312.098539:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815516160 00000100:00100000:2.0:1789683312.098653:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683312.098666:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815516160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683312.098782:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683312.098878:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815516160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 215us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683312.098885:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1789683312.098948:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe485da300 x1876618815516160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683328 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683312.098971:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815516160:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683312.099391:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683312.160981:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683313.183998:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683314.144593:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815516544:0@lo:400:kworker.0 00000100:00100000:1.0:1789683314.144689:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683314.144763:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789683314.144770:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815516416:0@lo:400:kworker.0 00000100:00100000:1.0:1789683314.144794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683314.144811:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815516928:0@lo:400:kworker.0 00000100:00100000:1.0:1789683314.144836:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683314.144893:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815516544 00000100:00100000:1.0:1789683314.144902:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815516544 00000100:00100000:1.0:1789683314.144960:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815516416 00000100:00100000:1.0:1789683314.144964:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815516416 00000100:00100000:3.0:1789683314.144979:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789683314.144993:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815516544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683314.145062:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815516544:12345-0@lo:400:kworker.0 Request processed in 73us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683314.145187:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815516288:0@lo:400:kworker.0 00000100:00100000:2.0:1789683314.145223:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683314.145247:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815516800:0@lo:400:kworker.0 00000100:00100000:2.0:1789683314.145268:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683314.145286:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683314.145292:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815516672:0@lo:400:kworker.0 00000100:00100000:2.0:1789683314.145313:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683314.145333:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683314.145340:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815517056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683314.145362:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683314.145388:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815516288 00000100:00100000:2.0:1789683314.145391:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815516288 00000100:00100000:2.0:1789683314.145419:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789683314.145426:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815516288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683314.145460:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815516288:12345-0@lo:400:kworker.0 Request processed in 35us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683314.145481:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789683314.145510:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815516928 00000100:00100000:2.0:1789683314.145519:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815516928 00000100:00100000:2.0:1789683314.145541:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815516672 00000100:00100000:2.0:1789683314.145544:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815516672 00000100:00100000:2.0:1789683314.145564:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789683314.145570:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815516928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683314.147907:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815516800 00000100:00100000:1.0:1789683314.147919:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815516800 00000100:00100000:1.0:1789683314.147955:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789683314.147963:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815516416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683314.148336:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789683314.148359:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789683314.148367:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815516800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683314.148411:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815516800:12345-0@lo:400:kworker.0 Request processed in 46us (3142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683314.148418:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789683314.153523:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815516928:12345-0@lo:400:kworker.0 Request processed in 7943us (8676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683314.153540:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789683314.153582:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789683314.153600:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815516672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683314.153706:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815516672:12345-0@lo:400:kworker.0 Request processed in 114us (8390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683314.153725:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683314.154261:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815517056 00000100:00100000:3.0:1789683314.154271:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815517056 00000100:00100000:3.0:1789683314.154312:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683314.154320:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815517056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683314.154349:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683314.154402:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815517056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (9039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683314.154409:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789683314.154520:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7b94a300 x1876618815517056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1789683314.154540:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76f36680 x1876618815516672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683314.154547:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815517056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683314.154560:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815516672:0@lo:400:kworker.0 00000100:00100000:3.0:1789683314.154576:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815516288:0@lo:400:kworker.0 00000100:00100000:3.0:1789683314.154587:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815516800:0@lo:400:kworker.0 00000100:00080000:2.0:1789683314.156183:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683314.156192:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683314.156195:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683314.156591:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c119180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815516416:12345-0@lo:400:kworker.0 Request processed in 8624us (11792us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683314.156604:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789683314.160408:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815516416:0@lo:400:kworker.0 00010000:00080000:3.0:1789683314.160549:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76f34a80 x1876618815516928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683314.160560:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815516928:0@lo:400:kworker.0 00000100:00100000:3.0:1789683314.160590:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815516544:0@lo:400:kworker.0 00010000:00010000:0.0:1789683314.208817:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683315.231863:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683315.874022:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683315.874063:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683315.874123:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802898560 00000100:00100000:0.0:1789683315.874133:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802898560 00000100:00100000:0.0:1789683315.874188:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:0.0:1789683315.874198:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802898560:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683315.874263:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802898560:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683315.874271:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:2.0:1789683315.874627:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802898688 00000100:00100000:2.0:1789683315.874632:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802898688 00000100:00080000:0.0:1789683315.874785:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683315.874884:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:2.0:1789683315.874893:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802898688:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683315.874943:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802898688:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 51us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683315.874964:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00010000:00010000:3.0:1789683316.259130:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683317.216248:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815517184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683317.216316:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683317.216829:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815517184 00000100:00100000:3.0:1789683317.216838:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815517184 00000100:00100000:3.0:1789683317.216898:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789683317.216908:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815517184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683317.216946:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683317.216998:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815517184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683317.217005:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789683317.217055:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683317.217123:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c430e00 x1876618815517184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683333 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683317.217140:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815517184:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789683317.279885:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683318.303887:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683319.264924:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815517312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683319.264986:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683319.265033:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815517824:0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.265058:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683319.265084:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683319.265090:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815517696:0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.265113:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683319.265140:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815517440:0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.265169:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683319.265191:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815517952:0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.265212:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683319.265228:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789683319.265233:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815517568:0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.265252:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683319.266668:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815518080:0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.266734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683319.266779:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815517312 00000100:00100000:2.0:1789683319.266786:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815517312 00000100:00100000:2.0:1789683319.266853:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683319.266863:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815517312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683319.266902:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683319.266949:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815517312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683319.266963:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683319.266990:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815517824 00000100:00100000:2.0:1789683319.266994:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815517824 00000100:00100000:2.0:1789683319.267017:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815518080 00000100:00100000:2.0:1789683319.267020:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815518080 00000100:00100000:2.0:1789683319.267036:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683319.267042:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815517824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.267077:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815517824:12345-0@lo:400:kworker.0 Request processed in 35us (2019us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683319.267082:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683319.267094:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683319.267100:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815518080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.267128:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815518080:12345-0@lo:400:kworker.0 Request processed in 29us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683319.267133:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789683319.269355:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683319.269362:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683319.269537:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815517696 00000100:00100000:1.0:1789683319.269559:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815517696 00000100:00100000:1.0:1789683319.269613:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815517952 00000100:00100000:1.0:1789683319.269616:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815517952 00000100:00100000:1.0:1789683319.269630:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815517568 00000100:00100000:1.0:1789683319.269633:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815517568 00000100:00100000:2.0:1789683319.272402:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789683319.273141:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683319.273200:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:3.0:1789683319.273210:0:5831:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:3.0:1789683319.273240:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815517440 00000100:00100000:3.0:1789683319.273248:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815517440 00000100:00100000:3.0:1789683319.273286:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:3.0:1789683319.273294:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815517440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683319.273374:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815517440:12345-0@lo:400:kworker.0 Request processed in 81us (8204us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683319.273382:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00010000:00080000:3.0:1789683319.273933:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76f36d80 x1876618815517312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683335 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683319.273955:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815517312:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789683319.273983:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76f34000 x1876618815517824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683319.273993:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815517824:0@lo:400:kworker.0 00000100:00100000:0.0:1789683319.274524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789683319.274537:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815517568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683319.274592:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815517568:12345-0@lo:400:kworker.0 Request processed in 61us (9339us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683319.274610:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789683319.276151:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815517696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.276238:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815517696:12345-0@lo:400:kworker.0 Request processed in 3823us (11121us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683319.276247:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789683319.276363:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815517696:0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.276537:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815517568:0@lo:400:kworker.0 00010000:00080000:2.0:1789683319.276552:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76f37800 x1876618815518080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683319.276562:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815518080:0@lo:400:kworker.0 00000100:00100000:2.0:1789683319.276571:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815517440:0@lo:400:kworker.0 00000100:00100000:1.0:1789683319.278013:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815517952:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789683319.282504:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683319.282603:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815517952:12345-0@lo:400:kworker.0 Request processed in 9451us (17387us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683319.282616:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789683319.282856:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815517952:0@lo:400:kworker.0 00010000:00010000:1.0:1789683319.329041:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683320.351902:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683320.994151:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683320.994196:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683320.994272:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802898944 00000100:00100000:1.0:1789683320.994283:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802898944 00000100:00100000:1.0:1789683320.994350:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:1.0:1789683320.994360:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802898944:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683320.994446:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802898944:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 87us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683320.994453:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00080000:0.0:1789683320.995559:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683320.995789:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802898816 00000100:00100000:3.0:1789683320.995796:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802898816 00000100:00100000:3.0:1789683320.995847:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:3.0:1789683320.995855:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2354:x1876618802898816:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683320.995922:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2354:x1876618802898816:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 68us (1780us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683320.995930:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 211 00010000:00010000:0.0:1789683321.378008:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683322.337762:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683322.337784:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815518208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683322.337851:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683322.337920:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815518208 00000100:00100000:3.0:1789683322.337928:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815518208 00000100:00100000:3.0:1789683322.337983:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789683322.337992:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815518208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683322.338027:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683322.338083:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815518208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683322.338089:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789683322.338109:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789683322.338136:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c431c00 x1876618815518208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683338 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683322.338173:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815518208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789683322.400864:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683323.431763:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683324.385205:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815518336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683324.385286:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683324.385358:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815518336 00000100:00100000:0.0:1789683324.385374:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815518336 00000100:00100000:0.0:1789683324.385436:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789683324.385445:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815518336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683324.385481:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683324.385525:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815518336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683324.385532:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1789683324.385552:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683324.385565:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815518848:0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.385569:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815518464:0@lo:400:kworker.0 00000100:00100000:0.0:1789683324.385590:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683324.385615:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789683324.386077:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7bd9a680 x1876618815518336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683340 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683324.386098:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815518336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683324.386113:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683324.386119:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815518720:0@lo:400:kworker.0 00000100:00100000:0.0:1789683324.386152:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683324.388569:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815518976:0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.388741:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683324.388784:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683324.388791:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815518592:0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.388814:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683324.388859:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815518848 00000100:00100000:2.0:1789683324.388867:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815518848 00000100:00100000:2.0:1789683324.388927:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789683324.388937:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815518848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.388995:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815518848:12345-0@lo:400:kworker.0 Request processed in 61us (3404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683324.389002:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789683324.389030:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815518464 00000100:00100000:2.0:1789683324.389033:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815518464 00000100:00100000:2.0:1789683324.389057:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789683324.389063:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815518464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.389096:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815518464:12345-0@lo:400:kworker.0 Request processed in 33us (3481us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683324.389102:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789683324.389131:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815518720 00000100:00100000:2.0:1789683324.389134:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815518720 00000100:00100000:2.0:1789683324.389159:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815518976 00000100:00100000:2.0:1789683324.389169:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815518976 00000100:00100000:2.0:1789683324.389189:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815518592 00000100:00100000:2.0:1789683324.389191:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815518592 00000100:00100000:2.0:1789683324.389203:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789683324.389208:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815518720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.389238:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815518720:12345-0@lo:400:kworker.0 Request processed in 30us (3086us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683324.389244:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789683324.396237:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789683324.396252:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815518976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.396343:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815518976:12345-0@lo:400:kworker.0 Request processed in 98us (7603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683324.396350:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789683324.396473:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789683324.396481:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815518592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.396514:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815518592:12345-0@lo:400:kworker.0 Request processed in 35us (7700us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683324.396519:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1789683324.396572:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683324.396577:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683324.398152:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815518720:0@lo:400:kworker.0 00010000:00080000:2.0:1789683324.398217:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76f37100 x1876618815518848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683324.398228:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815518848:0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.398266:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815518592:0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.398396:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815518464:0@lo:400:kworker.0 00000100:00100000:2.0:1789683324.398818:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815518976:0@lo:400:kworker.0 00010000:00010000:0.0:1789683324.447824:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683325.474255:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683326.122404:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683326.122473:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683326.122570:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802899072 00000100:00100000:0.0:1789683326.122583:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802899072 00000100:00100000:0.0:1789683326.122666:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:0.0:1789683326.122710:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802899072:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683326.122739:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802899200 00000100:00100000:2.0:1789683326.122743:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802899200 00000100:00100000:2.0:1789683326.122810:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:0.0:1789683326.122810:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802899072:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 103us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683326.122818:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802899200:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683326.122818:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:2.0:1789683326.122863:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802899200:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 47us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683326.122870:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00080000:3.0:1789683326.122956:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789683326.497004:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683327.483179:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815519104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683327.483258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683327.499453:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815519104 00000100:00100000:0.0:1789683327.499469:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815519104 00000100:00100000:0.0:1789683327.499753:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683327.499766:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815519104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683327.499808:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683327.499889:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815519104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (16630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683327.499897:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1789683327.499944:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c431c00 x1876618815519104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683327.499967:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815519104:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789683327.500554:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683327.522323:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789683328.028101:0:10116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:15:26 (1789683326) === 00010000:00010000:3.0:1789683328.543960:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683328.669807:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683328.669903:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802899328 00000100:00100000:2.0:1789683328.669914:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802899328 00000100:00100000:2.0:1789683328.669975:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:2.0:1789683328.669985:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+10:8122:x1876618802899328:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789683328.670002:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683328.670019:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8ce00/0x59bee33f93fea37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449eff3a expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.670056:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8ce00/0x59bee33f93fea37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff3a expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.670067:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8ce00/0x59bee33f93fea37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff3a expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683328.670077:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8ce00, rc 0) 00000100:00100000:2.0:1789683328.670136:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+11:8122:x1876618802899328:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 152us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.670156:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:0.0:1789683328.674911:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683328.675000:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802899456 00000100:00100000:1.0:1789683328.675011:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802899456 00000100:00100000:1.0:1789683328.675077:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:1.0:1789683328.675087:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+11:8122:x1876618802899456:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789683328.675426:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+11:8122:x1876618802899456:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 340us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.675435:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:1.0:1789683328.705021:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683328.705170:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802899584 00000100:00100000:0.0:1789683328.705180:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802899584 00000100:00100000:0.0:1789683328.705239:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:0.0:1789683328.705249:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+11:8122:x1876618802899584:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789683328.705496:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+11:8122:x1876618802899584:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 248us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.705505:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:3.0:1789683328.708921:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683328.709029:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802899712 00000100:00100000:2.0:1789683328.709038:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802899712 00000100:00100000:2.0:1789683328.709096:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:2.0:1789683328.709105:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+11:8126:x1876618802899712:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683328.709372:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+11:8126:x1876618802899712:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 266us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.709380:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:2.0:1789683328.744419:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683328.749725:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802899840 00000100:00100000:1.0:1789683328.749740:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802899840 00000100:00100000:1.0:1789683328.749887:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:1.0:1789683328.749899:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+11:8126:x1876618802899840:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789683328.750223:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+11:8126:x1876618802899840:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 325us (5812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.750232:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:1.0:1789683328.768977:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683328.769105:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802899968 00000100:00100000:0.0:1789683328.769116:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802899968 00000100:00100000:0.0:1789683328.769181:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:0.0:1789683328.769192:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+11:8122:x1876618802899968:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789683328.769208:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683328.769227:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40f400/0x59bee33f93fea3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449eff64 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.769262:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40f400/0x59bee33f93fea3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff64 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.769273:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40f400/0x59bee33f93fea3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff64 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683328.769282:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f400, rc 0) 00000100:00100000:0.0:1789683328.769361:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+12:8122:x1876618802899968:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 170us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.769368:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:3.0:1789683328.779265:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683328.779624:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802900096 00000100:00100000:1.0:1789683328.779634:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802900096 00000100:00100000:1.0:1789683328.779718:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:1.0:1789683328.779728:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+12:8122:x1876618802900096:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789683328.779754:0:5822:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789683328.779776:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789683328.779779:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789683328.779782:0:5822:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789683328.779785:0:5822:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789683328.782458:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+12:8122:x1876618802900096:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 2720us (3433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.782472:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:2.0:1789683328.796533:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683328.796739:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802900224 00000100:00100000:3.0:1789683328.796749:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802900224 00000100:00100000:3.0:1789683328.796806:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:3.0:1789683328.796817:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+12:8122:x1876618802900224:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683328.796833:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683328.796852:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449eff6b expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683328.796880:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff6b expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683328.796891:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff6b expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683328.796899:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8600, rc 0) 00000100:00100000:3.0:1789683328.796967:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:8122:x1876618802900224:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 151us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.796974:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:3.0:1789683328.801807:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683328.803724:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802900352 00000100:00100000:1.0:1789683328.803739:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802900352 00000100:00100000:1.0:1789683328.803820:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 222 00000100:00100000:1.0:1789683328.803831:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:8122:x1876618802900352:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789683328.804860:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:8122:x1876618802900352:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 1026us (3058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.804870:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 222 00000100:00100000:2.0:1789683328.817271:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683328.823232:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802900480 00000100:00100000:0.0:1789683328.823262:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802900480 00000100:00100000:0.0:1789683328.823334:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:0.0:1789683328.823344:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:8122:x1876618802900480:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789683328.823598:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:8122:x1876618802900480:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 254us (6346us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683328.823622:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:2.0:1789683328.836806:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683328.839553:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802900608 00000100:00100000:1.0:1789683328.839567:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802900608 00000100:00100000:1.0:1789683328.839654:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:1.0:1789683328.839666:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:8129:x1876618802900608:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789683328.839953:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:8129:x1876618802900608:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 289us (3156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.839962:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:1.0:1789683328.849404:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683328.851263:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802900736 00000100:00100000:3.0:1789683328.851278:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802900736 00000100:00100000:3.0:1789683328.851346:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:3.0:1789683328.851357:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:8129:x1876618802900736:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683328.851615:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:8129:x1876618802900736:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 250us (2209us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.851623:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:2.0:1789683328.865866:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683328.866055:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802900992 00000100:00100000:1.0:1789683328.866066:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802900992 00000100:00100000:1.0:1789683328.866143:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:1.0:1789683328.866153:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802900992:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683328.866232:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802900992:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.866239:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00080000:3.0:1789683328.866467:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683328.868325:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683328.868660:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802900864 00000100:00100000:3.0:1789683328.868670:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802900864 00000100:00100000:3.0:1789683328.868737:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1789683328.868744:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2351:x1876618802900864:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789683328.868772:0:9827:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 234683c5-3d03-46f5-a4e7-feef99fc60e0@192.168.203.60@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1789683328.868806:0:9827:0:(genops.c:1384:class_connect()) connect: client 234683c5-3d03-46f5-a4e7-feef99fc60e0, cookie 0x59bee33f93fea4c 00000004:00100000:3.0:1789683328.868838:0:9827:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789683328.869323:0:9827:0:(import.c:65:import_set_state_nolock()) ffff8dbd44c98000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683328.869394:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:2351:x1876618802900864:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 648us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.869401:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1789683328.872474:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683328.872563:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683328.872798:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802901120 00000100:00100000:2.0:1789683328.872809:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802901120 00000100:00100000:2.0:1789683328.872877:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802901248 00000100:00100000:2.0:1789683328.872881:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802901248 00000100:00100000:2.0:1789683328.872902:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1789683328.872911:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+7:0:x1876618802901120:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789683328.872952:0:6698:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789683328.873088:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+7:0:x1876618802901120:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 176us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.873095:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:2.0:1789683328.873113:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1789683328.873119:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:8122:x1876618802901248:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789683328.873143:0:6698:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789683328.873165:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:8122:x1876618802901248:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 46us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683328.873171:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00080000:3.0:1789683328.874059:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683328.884594:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683328.884733:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802901376 00000100:00100000:3.0:1789683328.884742:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802901376 00000100:00100000:3.0:1789683328.884795:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1789683328.884805:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:8122:x1876618802901376:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789683328.888652:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:8122:x1876618802901376:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 3835us (4054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.888698:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1789683328.908458:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683328.908531:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683328.908617:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683328.908848:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802901760 00000100:00100000:1.0:1789683328.908859:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802901760 00000100:00100000:1.0:1789683328.908918:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1789683328.908929:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:8122:x1876618802901760:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00200000:1.0:1789683328.909025:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789683328.909127:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:8122:x1876618802901760:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 200us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683328.909135:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1789683328.910410:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802901504 00000100:00100000:3.0:1789683328.910420:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802901504 00000100:00100000:3.0:1789683328.910464:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802901632 00000100:00100000:3.0:1789683328.910467:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802901632 00000100:00100000:3.0:1789683328.910521:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1789683328.910528:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876618802901504:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789683328.910553:0:6674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 234683c5-3d03-46f5-a4e7-feef99fc60e0@192.168.203.60@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1789683328.910593:0:6674:0:(genops.c:1384:class_connect()) connect: client 234683c5-3d03-46f5-a4e7-feef99fc60e0, cookie 0x59bee33f93fea53 00002000:00100000:3.0:1789683328.910614:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 234683c5-3d03-46f5-a4e7-feef99fc60e0/ffff8dbd44c9b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789683328.910653:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789683328.910905:0:6674:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789683328.910935:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8dbd44c9d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683328.910992:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:2351:x1876618802901504:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 462us (2543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.911000:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1789683328.911016:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1789683328.911020:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876618802901632:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789683328.911036:0:6674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 234683c5-3d03-46f5-a4e7-feef99fc60e0@192.168.203.60@tcp t0 exp 0000000000000000 cur 262 last 0 00000020:00000080:3.0:1789683328.911052:0:6674:0:(genops.c:1384:class_connect()) connect: client 234683c5-3d03-46f5-a4e7-feef99fc60e0, cookie 0x59bee33f93fea5a 00002000:00100000:3.0:1789683328.911058:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 234683c5-3d03-46f5-a4e7-feef99fc60e0/ffff8dbd44c9b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789683328.911073:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789683328.911195:0:6674:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789683328.911211:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bc43000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683328.911249:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:2351:x1876618802901632:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 226us (2729us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683328.911256:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1789683329.503934:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815519232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683329.504025:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683329.504132:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815519232 00000100:00100000:2.0:1789683329.504141:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815519232 00000100:00100000:2.0:1789683329.504205:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789683329.504215:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815519232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683329.504238:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683329.504280:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815519232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683329.504288:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789683329.504332:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76f36d80 x1876618815519232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683345 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683329.504350:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815519232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683329.505880:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815519488:0@lo:400:kworker.0 00000100:00100000:3.0:1789683329.505928:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683329.505955:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683329.505960:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815519616:0@lo:400:kworker.0 00000100:00100000:3.0:1789683329.505977:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683329.506004:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815519488 00000100:00100000:3.0:1789683329.506010:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815519488 00000100:00100000:3.0:1789683329.506043:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815519616 00000100:00100000:3.0:1789683329.506046:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815519616 00000100:00100000:3.0:1789683329.506064:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789683329.506071:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815519488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683329.506109:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815519488:12345-0@lo:400:kworker.0 Request processed in 38us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683329.506115:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789683329.506128:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683329.506133:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815519616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683329.506153:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815519616:12345-0@lo:400:kworker.0 Request processed in 20us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683329.506158:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1789683329.506173:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683329.506177:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683329.506199:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815519616:0@lo:400:kworker.0 00000100:00100000:3.0:1789683329.506207:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815519488:0@lo:400:kworker.0 00000100:00100000:1.0:1789683329.506313:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815519744:0@lo:400:kworker.0 00000100:00100000:1.0:1789683329.506347:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683329.506375:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789683329.506380:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815519360:0@lo:400:kworker.0 00000100:00100000:1.0:1789683329.506406:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683329.506431:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815519872:0@lo:400:kworker.0 00000100:00100000:1.0:1789683329.506450:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683329.506474:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815519360 00000100:00100000:1.0:1789683329.506477:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815519360 00000100:00100000:1.0:1789683329.506501:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789683329.506507:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815519360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683329.506538:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815519360:12345-0@lo:400:kworker.0 Request processed in 31us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683329.506544:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789683329.506589:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815519360:0@lo:400:kworker.0 00000100:00100000:3.0:1789683329.507012:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815519744 00000100:00100000:3.0:1789683329.507017:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815519744 00000100:00100000:3.0:1789683329.507060:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789683329.507067:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815519744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683329.507108:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815519744:12345-0@lo:400:kworker.0 Request processed in 42us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683329.507114:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1789683329.507143:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c431500 x1876618815519744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683329.507155:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815519744:0@lo:400:kworker.0 00000100:00100000:3.0:1789683329.507170:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815519872 00000100:00100000:3.0:1789683329.507174:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815519872 00000100:00100000:3.0:1789683329.507196:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789683329.507201:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815519872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683329.507232:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815519872:12345-0@lo:400:kworker.0 Request processed in 31us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683329.507238:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789683329.507260:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815519872:0@lo:400:kworker.0 00000100:00080000:1.0:1789683329.509049:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683329.509058:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683329.580858:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789683329.598280:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 234683c5-3d03-46f5-a4e7-feef99fc60e0 00000001:00100000:2.0:1789683329.603086:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 234683c5-3d03-46f5-a4e7-feef99fc60e0 00000001:00100000:0.0:1789683330.574089:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 234683c5-3d03-46f5-a4e7-feef99fc60e0 00010000:00010000:0.0:1789683330.593764:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683331.620862:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683332.577266:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683332.577289:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815520000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683332.577355:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683332.578744:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815520000 00000100:00100000:3.0:1789683332.578754:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815520000 00000100:00100000:3.0:1789683332.578820:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683332.578842:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815520000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683332.578891:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683332.578964:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815520000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (1609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683332.578971:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789683332.579014:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c430a80 x1876618815520000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683332.579034:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815520000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683332.579163:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789683332.639832:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683333.664107:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683334.307151:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683334.307198:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683334.307246:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683334.307276:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683334.307297:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683334.307327:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802902272 00000100:00100000:2.0:1789683334.307337:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802902272 00000100:00100000:2.0:1789683334.307386:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802902400 00000100:00100000:2.0:1789683334.307389:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802902400 00000100:00100000:2.0:1789683334.307409:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:2.0:1789683334.307418:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802902272:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683334.307487:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802902272:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 69us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683334.307494:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:2.0:1789683334.307511:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:2.0:1789683334.307517:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802902400:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683334.307552:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802902400:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 36us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683334.307559:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:1.0:1789683334.307766:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802901888 00000100:00100000:1.0:1789683334.307770:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802901888 00000100:00100000:1.0:1789683334.307807:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:1.0:1789683334.307815:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802901888:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683334.307846:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802901888:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 32us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683334.307860:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00080000:0.0:1789683334.308195:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683334.308201:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683334.308379:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802902016 00000100:00100000:3.0:1789683334.308384:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802902016 00000100:00100000:3.0:1789683334.308464:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802902144 00000100:00100000:3.0:1789683334.308468:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802902144 00000100:00100000:3.0:1789683334.308498:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1789683334.308506:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802902016:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683334.308554:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802902016:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 49us (1412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683334.308560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1789683334.308584:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1789683334.308591:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802902144:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683334.308616:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802902144:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683334.308622:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00080000:0.0:1789683334.308791:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683334.624015:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c11ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815520256:0@lo:400:kworker.0 00000100:00100000:1.0:1789683334.624082:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683334.624134:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c118000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815520768:0@lo:400:kworker.0 00000100:00100000:1.0:1789683334.624161:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683334.624190:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683334.624196:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815520384:0@lo:400:kworker.0 00000100:00100000:1.0:1789683334.624216:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683334.624244:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815520256 00000100:00100000:1.0:1789683334.624251:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815520256 00000100:00100000:1.0:1789683334.624285:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815520384 00000100:00100000:1.0:1789683334.624288:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815520384 00000100:00100000:1.0:1789683334.624316:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789683334.624322:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815520768 00000100:00100000:1.0:1789683334.624324:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815520256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683334.624326:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815520768 00000100:00100000:2.0:1789683334.624369:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789683334.624372:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815520256:12345-0@lo:400:kworker.0 Request processed in 50us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683334.624376:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815520768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683334.624379:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789683334.624395:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789683334.624400:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815520384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683334.624408:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76246c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815520768:12345-0@lo:400:kworker.0 Request processed in 33us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683334.624413:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789683334.624421:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815520384:12345-0@lo:400:kworker.0 Request processed in 22us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683334.624426:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789683334.624457:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c118700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815520384:0@lo:400:kworker.0 00000100:00100000:1.0:1789683334.624466:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c11ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815520256:0@lo:400:kworker.0 00010000:00080000:1.0:1789683334.624491:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c118000 x1876618815520768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683334.624501:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c118000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815520768:0@lo:400:kworker.0 00000100:00100000:0.0:1789683334.624653:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c11b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815520512:0@lo:400:kworker.0 00000100:00100000:0.0:1789683334.624702:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683334.624724:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789683334.624730:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c119880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815520128:0@lo:400:kworker.0 00000100:00100000:0.0:1789683334.624754:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683334.624776:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c11a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815520640:0@lo:400:kworker.0 00000100:00100000:0.0:1789683334.624794:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789683334.624817:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683334.624821:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683334.624831:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815520128 00000100:00100000:0.0:1789683334.624834:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815520128 00000100:00100000:0.0:1789683334.624860:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789683334.624866:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815520128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683334.624900:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815520128:12345-0@lo:400:kworker.0 Request processed in 34us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683334.624906:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789683334.624940:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815520512 00000100:00100000:0.0:1789683334.624944:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815520512 00000100:00100000:0.0:1789683334.624973:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683334.624979:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815520512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683334.625008:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815520512:12345-0@lo:400:kworker.0 Request processed in 30us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683334.625014:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789683334.625030:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683334.625039:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815520640 00000100:00100000:0.0:1789683334.625042:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815520640 00000100:00100000:0.0:1789683334.625066:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789683334.625072:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815520640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683334.625101:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815520640:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683334.625107:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789683334.625119:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683334.625134:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c119880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815520128:0@lo:400:kworker.0 00000100:00100000:0.0:1789683334.625144:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c11a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815520640:0@lo:400:kworker.0 00000100:00100000:1.0:1789683334.625149:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815520896:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789683334.625153:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c11b100 x1876618815520512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683350 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683334.625161:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c11b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815520512:0@lo:400:kworker.0 00000100:00100000:1.0:1789683334.625177:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683334.625248:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815520896 00000100:00100000:3.0:1789683334.625253:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815520896 00000100:00100000:3.0:1789683334.625290:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789683334.625304:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815520896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683334.625330:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683334.625376:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815520896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683334.625381:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1789683334.625556:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe6fef0700 x1876618815520896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683350 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683334.625756:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815520896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789683334.688301:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683335.516340:0:10311:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1789683335.718980:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683336.735950:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683337.699551:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815521024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683337.699616:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683337.699853:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815521024 00000100:00100000:3.0:1789683337.699861:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815521024 00000100:00100000:3.0:1789683337.699922:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789683337.699932:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815521024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683337.699967:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683337.700011:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815521024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683337.700018:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789683337.700396:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683337.700438:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c430a80 x1876618815521024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683337.700455:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815521024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789683337.759882:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683338.786020:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683339.431665:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683339.431724:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683339.431753:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683339.431773:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683339.431808:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683339.431841:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802902784 00000100:00100000:0.0:1789683339.431851:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802902784 00000100:00100000:0.0:1789683339.431905:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802902656 00000100:00100000:0.0:1789683339.431908:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802902656 00000100:00100000:0.0:1789683339.431932:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:0.0:1789683339.431942:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802902784:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683339.432029:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802902784:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 89us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683339.432037:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:0.0:1789683339.432055:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:0.0:1789683339.432061:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802902656:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683339.432090:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802902656:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683339.432096:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:0.0:1789683339.432118:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802903040 00000100:00100000:0.0:1789683339.432131:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802903040 00000100:00100000:0.0:1789683339.432157:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802902912 00000100:00100000:0.0:1789683339.432159:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802902912 00000100:00100000:0.0:1789683339.432176:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1789683339.432183:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802903040:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683339.432208:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802903040:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683339.432213:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1789683339.432223:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:0.0:1789683339.432229:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802902912:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683339.432264:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802902912:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 35us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683339.432270:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00080000:0.0:1789683339.432289:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683339.432292:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683339.432295:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683339.434196:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802902528 00000100:00100000:3.0:1789683339.434210:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802902528 00000100:00100000:3.0:1789683339.434310:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:3.0:1789683339.434322:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802902528:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683339.434403:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802902528:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 84us (2761us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683339.434410:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:2.0:1789683339.755108:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683339.755129:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815521152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683339.755209:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683339.755593:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815521152 00000100:00100000:2.0:1789683339.755602:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815521152 00000100:00100000:2.0:1789683339.757658:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789683339.757683:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815521152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683339.757724:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683339.757805:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815521152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683339.757812:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1789683339.758147:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76a33b80 x1876618815521152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683355 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683339.758168:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815521152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683339.760971:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815521408:0@lo:400:kworker.0 00000100:00100000:2.0:1789683339.761037:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683339.761076:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789683339.761082:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815521280:0@lo:400:kworker.0 00000100:00100000:2.0:1789683339.761109:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683339.761134:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815521792:0@lo:400:kworker.0 00000100:00100000:2.0:1789683339.761153:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683339.761181:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815521408 00000100:00100000:2.0:1789683339.761187:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815521408 00000100:00100000:1.0:1789683339.761456:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815521664:0@lo:400:kworker.0 00000100:00100000:1.0:1789683339.761488:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683339.761508:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683339.761513:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815521536:0@lo:400:kworker.0 00000100:00100000:1.0:1789683339.761545:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683339.761569:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815521664 00000100:00100000:1.0:1789683339.761573:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815521664 00000100:00100000:2.0:1789683339.761734:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815521792 00000100:00100000:2.0:1789683339.761737:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815521792 00000100:00080000:3.0:1789683339.761787:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683339.761792:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683339.761794:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683339.763318:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815521536 00000100:00100000:0.0:1789683339.763327:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815521536 00000100:00100000:0.0:1789683339.763417:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789683339.763428:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815521408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683339.763514:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815521408:12345-0@lo:400:kworker.0 Request processed in 89us (2477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683339.763521:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789683339.763553:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789683339.763560:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815521536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683339.763593:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815521536:12345-0@lo:400:kworker.0 Request processed in 35us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683339.763610:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789683339.763661:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815521536:0@lo:400:kworker.0 00000100:00100000:0.0:1789683339.763711:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815521408:0@lo:400:kworker.0 00000100:00080000:3.0:1789683339.770022:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683339.772287:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815521280 00000100:00100000:3.0:1789683339.772302:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815521280 00000100:00100000:3.0:1789683339.772368:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1789683339.772378:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815521280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683339.772468:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815521280:12345-0@lo:400:kworker.0 Request processed in 92us (11358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683339.772476:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1789683339.773120:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815521280:0@lo:400:kworker.0 00000100:00100000:1.0:1789683339.773577:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789683339.773587:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815521664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683339.773647:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815521664:12345-0@lo:400:kworker.0 Request processed in 63us (12159us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683339.773654:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789683339.773848:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76a32300 x1876618815521664/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683355 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683339.773861:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815521664:0@lo:400:kworker.0 00000100:00100000:2.0:1789683339.774145:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789683339.774153:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815521792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683339.774214:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815521792:12345-0@lo:400:kworker.0 Request processed in 61us (13059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683339.774231:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789683339.774268:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815521792:0@lo:400:kworker.0 00010000:00010000:0.0:1789683339.808340:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683340.832295:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683341.857142:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683342.818641:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815521920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683342.818726:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683342.818810:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815521920 00000100:00100000:2.0:1789683342.818818:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815521920 00000100:00100000:2.0:1789683342.818867:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789683342.818876:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815521920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683342.818910:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683342.818954:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815521920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683342.818960:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789683342.818980:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683342.819009:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c431f80 x1876618815521920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683342.819038:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815521920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789683342.880753:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683343.910588:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683344.548331:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683344.548373:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683344.548398:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683344.548418:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683344.549916:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683344.549960:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802903424 00000100:00100000:1.0:1789683344.549969:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802903424 00000100:00100000:1.0:1789683344.550030:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802903296 00000100:00100000:1.0:1789683344.550034:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802903296 00000100:00100000:1.0:1789683344.550055:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1789683344.550064:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802903424:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683344.550139:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802903424:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 76us (1764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683344.550147:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1789683344.550162:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1789683344.550169:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802903296:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683344.550192:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802903296:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 24us (1774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683344.550198:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:1.0:1789683344.550215:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802903680 00000100:00100000:1.0:1789683344.550219:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802903680 00000100:00100000:1.0:1789683344.550240:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802903552 00000100:00100000:1.0:1789683344.550243:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802903552 00000100:00100000:1.0:1789683344.550262:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1789683344.550269:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802903680:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683344.550296:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802903680:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683344.550303:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1789683344.550315:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1789683344.550321:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802903552:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683344.550344:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802903552:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 23us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683344.550359:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00080000:1.0:1789683344.550379:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683344.550383:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683344.550386:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683344.550587:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802903168 00000100:00100000:3.0:1789683344.550592:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802903168 00000100:00100000:3.0:1789683344.550621:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:3.0:1789683344.550628:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802903168:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683344.550657:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802903168:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 30us (2337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683344.551233:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:0.0:1789683344.864216:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683344.864240:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815522048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683344.864328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683344.864641:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815522048 00000100:00100000:2.0:1789683344.864649:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815522048 00000100:00100000:2.0:1789683344.864726:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789683344.864735:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815522048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683344.864765:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683344.864812:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815522048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683344.864819:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:2.0:1789683344.864860:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe6fef1f80 x1876618815522048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683360 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683344.864884:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815522048:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789683344.864949:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683344.867199:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815522304:0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867275:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683344.867316:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683344.867322:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815522432:0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867345:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683344.867376:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815522304 00000100:00100000:1.0:1789683344.867384:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815522304 00000100:00100000:1.0:1789683344.867423:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815522432 00000100:00100000:1.0:1789683344.867426:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815522432 00000100:00100000:1.0:1789683344.867463:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789683344.867471:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815522304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867533:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815522304:12345-0@lo:400:kworker.0 Request processed in 62us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683344.867539:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789683344.867554:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789683344.867560:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815522432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867587:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815522432:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683344.867592:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1789683344.867612:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683344.867639:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815522432:0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867649:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815522304:0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867718:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815522176:0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867748:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683344.867776:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815522688:0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867797:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683344.867813:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683344.867818:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815522560:0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683344.867867:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815522176 00000100:00100000:1.0:1789683344.867871:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815522176 00000100:00100000:1.0:1789683344.867896:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789683344.867902:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815522176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.867934:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815522176:12345-0@lo:400:kworker.0 Request processed in 32us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683344.867940:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1789683344.867965:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815522560 00000100:00100000:1.0:1789683344.867969:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815522560 00000100:00100000:1.0:1789683344.867996:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789683344.868003:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815522560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.868030:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815522560:12345-0@lo:400:kworker.0 Request processed in 28us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683344.868036:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789683344.868052:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683344.868068:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c430a80 x1876618815522560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683344.868079:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815522560:0@lo:400:kworker.0 00000100:00100000:1.0:1789683344.868097:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815522176:0@lo:400:kworker.0 00000100:00100000:3.0:1789683344.868904:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815522688 00000100:00100000:3.0:1789683344.868911:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815522688 00000100:00100000:3.0:1789683344.868950:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789683344.868958:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815522688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683344.869009:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815522688:12345-0@lo:400:kworker.0 Request processed in 53us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683344.869016:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:1.0:1789683344.871094:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683344.871155:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815522688:0@lo:400:kworker.0 00010000:00010000:3.0:1789683344.928977:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683345.952529:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683346.977834:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683347.936914:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683347.936938:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815522816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683347.937008:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683347.937167:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815522816 00000100:00100000:3.0:1789683347.937175:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815522816 00000100:00100000:3.0:1789683347.937268:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789683347.937280:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815522816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683347.937318:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683347.937366:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815522816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683347.937373:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1789683347.937412:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c431c00 x1876618815522816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683347.937442:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815522816:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683347.937561:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683347.999923:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683349.040762:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683349.670014:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683349.670053:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683349.670077:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683349.670099:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683349.670195:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802903808 00000100:00100000:3.0:1789683349.670205:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802903808 00000100:00100000:3.0:1789683349.670251:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:3.0:1789683349.670261:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802903808:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683349.670326:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802903808:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 65us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.670334:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:3.0:1789683349.670364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802904064 00000100:00100000:3.0:1789683349.670368:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802904064 00000100:00100000:3.0:1789683349.670400:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802903936 00000100:00100000:3.0:1789683349.670403:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802903936 00000100:00100000:3.0:1789683349.670424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:3.0:1789683349.670430:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802904064:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683349.671032:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802904064:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 598us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.671040:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:3.0:1789683349.671059:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:3.0:1789683349.671067:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802903936:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683349.671095:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802903936:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.671101:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00080000:3.0:1789683349.672735:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683349.676758:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802904192 00000100:00100000:3.0:1789683349.676773:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802904192 00000100:00100000:3.0:1789683349.676857:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:3.0:1789683349.676868:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2351:x1876618802904192:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:3.0:1789683349.676903:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fea53 00000100:00080000:3.0:1789683349.676912:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8dbd44c9d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683349.676949:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789683349.677296:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+2:2351:x1876618802904192:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 428us (7289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.677304:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:3.0:1789683349.677325:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683349.677826:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00080000:0.0:1789683349.679614:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683349.680021:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802904320 00000100:00100000:0.0:1789683349.680031:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802904320 00000100:00100000:0.0:1789683349.680101:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1789683349.680122:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2351:x1876618802904320:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1789683349.680149:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fea5a 00000100:00080000:0.0:1789683349.680157:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bc43000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683349.680193:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789683349.680754:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a31c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+2:2351:x1876618802904320:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 634us (2927us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683349.680778:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00010000:00010000:0.0:1789683349.680842:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683349.682253:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683349.985121:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815522944:0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.985189:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683349.985233:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815523456:0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.985259:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683349.985294:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683349.985310:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815523328:0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.985337:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683349.985362:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815523200:0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.985384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683349.985401:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789683349.985418:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815523072:0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.985439:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683349.985466:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815523584:0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.985484:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683349.985512:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815522944 00000100:00100000:3.0:1789683349.985519:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815522944 00000100:00100000:3.0:1789683349.985560:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789683349.985567:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815522944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.985620:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815522944:12345-0@lo:400:kworker.0 Request processed in 54us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.985626:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789683349.985658:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815523456 00000100:00100000:3.0:1789683349.985662:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815523456 00000100:00100000:3.0:1789683349.985711:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815523200 00000100:00100000:3.0:1789683349.985715:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815523200 00000100:00100000:3.0:1789683349.985731:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815523072 00000100:00100000:3.0:1789683349.985734:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815523072 00000100:00100000:3.0:1789683349.985747:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789683349.985753:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815523456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.985784:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815523456:12345-0@lo:400:kworker.0 Request processed in 32us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.985790:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789683349.985810:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789683349.985816:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815523200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.985849:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815523200:12345-0@lo:400:kworker.0 Request processed in 33us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.985855:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789683349.985866:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789683349.988534:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815523072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.988615:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815523072:12345-0@lo:400:kworker.0 Request processed in 93us (3175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.988622:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789683349.988684:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815523328 00000100:00100000:3.0:1789683349.988691:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815523328 00000100:00100000:3.0:1789683349.988727:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815523584 00000100:00100000:3.0:1789683349.988730:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815523584 00000100:00100000:3.0:1789683349.988754:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683349.988762:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815523328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.988796:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815523328:12345-0@lo:400:kworker.0 Request processed in 36us (3459us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.988802:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683349.988814:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683349.988820:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815523584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683349.988849:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815523584:12345-0@lo:400:kworker.0 Request processed in 30us (3363us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683349.988855:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1789683349.989244:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683349.989249:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683349.989251:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683349.989307:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683349.989320:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815523712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683349.989357:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683349.992697:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815523072:0@lo:400:kworker.0 00010000:00080000:2.0:1789683349.992719:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c431880 x1876618815523584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683349.992730:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815523584:0@lo:400:kworker.0 00000100:00100000:2.0:1789683349.992741:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815523200:0@lo:400:kworker.0 00010000:00080000:2.0:1789683349.992781:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c432680 x1876618815523328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683365 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683349.992791:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815523328:0@lo:400:kworker.0 00000100:00100000:2.0:1789683349.992801:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815522944:0@lo:400:kworker.0 00000100:00100000:2.0:1789683349.992813:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815523456:0@lo:400:kworker.0 00000100:00100000:3.0:1789683350.003052:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815523712 00000100:00100000:3.0:1789683350.003067:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815523712 00000100:00100000:3.0:1789683350.003123:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683350.003140:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815523712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683350.003179:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683350.003253:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815523712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (13895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683350.003260:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1789683350.003496:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76a30380 x1876618815523712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683350.003516:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815523712:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789683350.051487:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789683350.090375:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 234683c5-3d03-46f5-a4e7-feef99fc60e0 00000020:00000080:0.0:1789683350.090384:0:7641:0:(genops.c:885:class_export_put()) final put ffff8dbd44c9b000/234683c5-3d03-46f5-a4e7-feef99fc60e0 00000020:00000080:0.0:1789683350.090409:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44c9b000/234683c5-3d03-46f5-a4e7-feef99fc60e0 for lustre-OST0001 00000020:00000080:0.0:1789683350.090459:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe7bc43000 for lustre-OST0001 00000001:00100000:1.0:1789683350.135976:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 234683c5-3d03-46f5-a4e7-feef99fc60e0 00000020:00000080:1.0:1789683350.135986:0:6700:0:(genops.c:885:class_export_put()) final put ffff8dbd44c9b800/234683c5-3d03-46f5-a4e7-feef99fc60e0 00000020:00000080:2.0:1789683350.136052:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44c9b800/234683c5-3d03-46f5-a4e7-feef99fc60e0 for lustre-OST0000 00000020:00000080:2.0:1789683350.136105:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbd44c9d000 for lustre-OST0000 00010000:00010000:1.0:1789683351.073226:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683352.096052:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683353.055914:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815523840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683353.055993:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683353.056241:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815523840 00000100:00100000:3.0:1789683353.056254:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815523840 00000100:00080000:0.0:1789683353.056337:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683353.056351:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789683353.056377:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815523840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683353.056446:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683353.058268:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815523840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1885us (2265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683353.058284:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1789683353.058477:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe485d9880 x1876618815523840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683353.058503:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815523840:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789683353.123900:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683354.154617:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683354.789032:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683354.789075:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683354.789108:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683354.789246:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802904448 00000100:00100000:1.0:1789683354.789258:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802904448 00000100:00100000:1.0:1789683354.789316:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:1.0:1789683354.789326:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802904448:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683354.789420:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802904448:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 86us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683354.789428:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:0.0:1789683354.789733:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802904704 00000100:00100000:0.0:1789683354.789738:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802904704 00000100:00100000:0.0:1789683354.789785:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802904576 00000100:00100000:0.0:1789683354.789788:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802904576 00000100:00100000:0.0:1789683354.789809:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:0.0:1789683354.789817:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802904704:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683354.789857:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802904704:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 41us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683354.789864:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:0.0:1789683354.789878:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:0.0:1789683354.789899:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802904576:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683354.789926:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802904576:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683354.789933:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00080000:1.0:1789683354.790340:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683355.104176:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815524096:0@lo:400:kworker.0 00000100:00100000:3.0:1789683355.104245:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683355.104299:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815524608:0@lo:400:kworker.0 00000100:00100000:3.0:1789683355.104324:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683355.104352:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683355.104357:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815524224:0@lo:400:kworker.0 00000100:00100000:3.0:1789683355.104390:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683355.104439:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815524608 00000100:00100000:3.0:1789683355.104448:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815524608 00000100:00100000:3.0:1789683355.104517:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789683355.104525:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815524608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683355.104578:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815524608:12345-0@lo:400:kworker.0 Request processed in 54us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683355.104585:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789683355.104606:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683355.104628:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815524096 00000100:00100000:3.0:1789683355.104632:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815524096 00000100:00100000:3.0:1789683355.104655:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815524224 00000100:00100000:3.0:1789683355.104658:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815524224 00000100:00100000:3.0:1789683355.104701:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789683355.104708:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815524096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683355.104739:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815524096:12345-0@lo:400:kworker.0 Request processed in 32us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683355.104745:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789683355.104756:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789683355.104762:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815524224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683355.104788:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815524224:12345-0@lo:400:kworker.0 Request processed in 26us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683355.104793:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:3.0:1789683355.104812:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683355.104838:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815524224:0@lo:400:kworker.0 00000100:00100000:3.0:1789683355.104849:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815524096:0@lo:400:kworker.0 00010000:00080000:3.0:1789683355.104860:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760c6a00 x1876618815524608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683355.104869:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815524608:0@lo:400:kworker.0 00000100:00100000:2.0:1789683355.105287:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815524736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683355.105319:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683355.105376:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815524736 00000100:00100000:2.0:1789683355.105380:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815524736 00000100:00100000:2.0:1789683355.105425:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789683355.105432:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815524736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683355.105465:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683355.105511:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815524736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683355.105517:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789683355.105804:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76a31500 x1876618815524736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683371 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683355.105819:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815524736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683355.108781:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815523968:0@lo:400:kworker.0 00000100:00100000:0.0:1789683355.108859:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683355.108899:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815524480:0@lo:400:kworker.0 00000100:00100000:0.0:1789683355.108924:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683355.108951:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683355.108957:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815524352:0@lo:400:kworker.0 00000100:00100000:0.0:1789683355.108981:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683355.109037:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815524352 00000100:00100000:0.0:1789683355.109045:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815524352 00000100:00100000:0.0:1789683355.109095:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789683355.109104:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815524352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683355.109153:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815524352:12345-0@lo:400:kworker.0 Request processed in 50us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683355.109160:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1789683355.109182:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683355.109207:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760c5500 x1876618815524352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683371 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683355.109223:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815524352:0@lo:400:kworker.0 00000100:00100000:1.0:1789683355.109361:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815523968 00000100:00100000:1.0:1789683355.109376:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815523968 00000100:00100000:1.0:1789683355.109418:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789683355.109426:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815523968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683355.109462:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815523968:12345-0@lo:400:kworker.0 Request processed in 38us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683355.109468:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1789683355.109734:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815523968:0@lo:400:kworker.0 00000100:00100000:2.0:1789683355.110293:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815524480 00000100:00100000:2.0:1789683355.110299:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815524480 00000100:00100000:2.0:1789683355.110345:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789683355.110353:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815524480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683355.110420:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815524480:12345-0@lo:400:kworker.0 Request processed in 59us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683355.110426:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1789683355.110605:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683355.110636:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815524480:0@lo:400:kworker.0 00010000:00010000:0.0:1789683355.167851:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683356.196034:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789683356.835426:0:11015:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789683357.215949:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683358.190341:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683358.190377:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815524864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683358.190473:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683358.190650:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815524864 00000100:00100000:3.0:1789683358.190659:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815524864 00000100:00100000:3.0:1789683358.190739:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789683358.190750:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815524864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683358.190787:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683358.190833:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815524864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683358.190840:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1789683358.190881:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760c6a00 x1876618815524864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683358.190899:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815524864:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789683358.193221:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789683358.241916:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683359.271953:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683359.914648:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683359.914926:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802904832 00000100:00100000:2.0:1789683359.914937:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802904832 00000100:00100000:2.0:1789683359.919184:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:2.0:1789683359.919221:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802904832:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683359.919316:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802904832:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 109us (4675us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683359.919324:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:3.0:1789683359.919526:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683359.919551:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802905088 00000100:00100000:3.0:1789683359.919558:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802905088 00000100:00100000:3.0:1789683359.919615:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:3.0:1789683359.919623:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802905088:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683359.919662:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802905088:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 40us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683359.919667:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:3.0:1789683359.919718:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683359.919732:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802904960 00000100:00100000:0.0:1789683359.919737:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802904960 00000100:00100000:0.0:1789683359.919763:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:0.0:1789683359.919770:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802904960:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683359.919808:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802904960:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 39us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683359.919814:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00080000:2.0:1789683359.935433:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683360.224075:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815525376:0@lo:400:kworker.0 00000100:00100000:0.0:1789683360.224150:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683360.224217:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789683360.224224:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815524992:0@lo:400:kworker.0 00000100:00100000:0.0:1789683360.224251:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683360.224271:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815525504:0@lo:400:kworker.0 00000100:00100000:0.0:1789683360.224292:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683360.224362:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815525376 00000100:00100000:1.0:1789683360.224379:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815525376 00000100:00100000:1.0:1789683360.224438:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789683360.224461:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815525376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683360.224515:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815525376:12345-0@lo:400:kworker.0 Request processed in 57us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683360.224522:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1789683360.224852:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789683360.224883:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76c22d80 x1876618815525376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683360.224896:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815525376:0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.224971:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815525120:0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.225003:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683360.225031:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815525632:0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.225065:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683360.225103:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683360.225109:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815525248:0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.225128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683360.225156:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815524992 00000100:00100000:3.0:1789683360.225160:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815524992 00000100:00100000:3.0:1789683360.225187:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789683360.225194:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815524992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.225230:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815524992:12345-0@lo:400:kworker.0 Request processed in 37us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683360.225236:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789683360.225262:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815525504 00000100:00100000:3.0:1789683360.225265:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815525504 00000100:00100000:3.0:1789683360.225293:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815525120 00000100:00100000:3.0:1789683360.225295:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815525120 00000100:00100000:3.0:1789683360.225309:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815525248 00000100:00100000:3.0:1789683360.225312:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815525248 00000100:00100000:3.0:1789683360.225325:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789683360.225344:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815525504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.225386:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815525504:12345-0@lo:400:kworker.0 Request processed in 44us (1093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683360.225393:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789683360.225404:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789683360.225410:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815525120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.225439:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815525120:12345-0@lo:400:kworker.0 Request processed in 30us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683360.225445:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789683360.225465:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789683360.225470:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815525248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.225498:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815525248:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683360.225503:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:3.0:1789683360.225526:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683360.226059:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815525248:0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.226071:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815525120:0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.226118:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815524992:0@lo:400:kworker.0 00000100:00100000:3.0:1789683360.226129:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815525504:0@lo:400:kworker.0 00000100:00100000:1.0:1789683360.226571:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815525632 00000100:00100000:1.0:1789683360.226578:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815525632 00000100:00100000:1.0:1789683360.226631:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789683360.226639:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815525632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683360.226722:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815525632:12345-0@lo:400:kworker.0 Request processed in 85us (1656us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683360.226728:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789683360.226879:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789683360.226904:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76c23100 x1876618815525632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683360.226915:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815525632:0@lo:400:kworker.0 00000100:00100000:0.0:1789683360.227346:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683360.227356:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815525760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683360.227403:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683360.227446:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815525760 00000100:00100000:0.0:1789683360.227451:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815525760 00000100:00100000:0.0:1789683360.227477:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789683360.227484:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815525760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683360.227509:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683360.227544:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815525760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683360.227550:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1789683360.227578:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760a1880 x1876618815525760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683360.227592:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815525760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789683360.288313:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683361.323565:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789683361.804582:0:11164:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeadc43610 20000000:00000080:2.0:1789683361.804598:0:11164:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dbe760c1800 uarg=0000000000000000 20000000:01000000:2.0:1789683361.804629:0:11164:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789683361.804634:0:11164:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789683361.804638:0:11164:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789683361.805964:0:11165:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789683361.806099:0:11164:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789683361.813268:0:11164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789683361.813298:0:11164:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813391:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff33 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813467:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea06 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813476:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea1b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813495:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea29 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813502:0:11164:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff6b expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813509:0:11164:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813550:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff6b expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813565:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff6b expref: 12 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683361.813585:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815525888:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683361.813786:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fea29 expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813795:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fea29 expref: 18 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683361.813803:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815526016:0@lo:104: 00000100:00100000:2.0:1789683361.813840:0:11164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683361.813874:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fea1b expref: 18 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.813881:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fea1b expref: 18 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683361.813900:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815526144:0@lo:104: 00000100:00100000:2.0:1789683361.813922:0:11164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.813953:0:7628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815526016 00000100:00100000:2.0:1789683361.813960:0:7628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815526016 00000100:00100000:2.0:1789683361.814000:0:7628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815526144 00000100:00100000:2.0:1789683361.814004:0:7628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815526144 00000100:00100000:2.0:1789683361.814028:0:7628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683361.814036:0:7628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:08ddc492-5684-492d-ac6b-b8fd660301db+4:11164:x1876618815526016:12345-0@lo:104: 00010000:00010000:2.0:1789683361.814049:0:7628:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814093:0:7628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789683361.814098:0:7628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:08ddc492-5684-492d-ac6b-b8fd660301db+4:11164:x1876618815526016:12345-0@lo:104: Request processed in 63us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.814105:0:7628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683361.814121:0:7628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789683361.814127:0:7628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c430a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:08ddc492-5684-492d-ac6b-b8fd660301db+3:11164:x1876618815526144:12345-0@lo:104: 00010000:00010000:2.0:1789683361.814135:0:7628:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814164:0:7628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789683361.814169:0:7628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c430a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:08ddc492-5684-492d-ac6b-b8fd660301db+3:11164:x1876618815526144:12345-0@lo:104: Request processed in 43us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.814174:0:7628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789683361.814193:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683361.814199:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814216:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e400 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683361.814220:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814228:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683361.814235:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683361.814240:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683361.814267:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814273:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683361.814292:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814298:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e400/0x59bee33f93fea29 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea30 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814310:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683361.814313:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.814822:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683361.814918:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ee00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683361.814921:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814939:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683361.814945:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683361.814950:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683361.814966:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814973:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683361.814980:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814986:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93fea1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea22 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.814995:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683361.814997:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683361.814998:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683361.815081:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815526400:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683361.815119:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.815189:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683361.815195:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815526272:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683361.815230:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683361.817295:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fea06 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.817310:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fea06 expref: 18 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683361.817345:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815526528:0@lo:104: 00000100:00100000:2.0:1789683361.819233:0:11164:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.819283:0:7628:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815526528 00000100:00100000:2.0:1789683361.819291:0:7628:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815526528 00000100:00100000:2.0:1789683361.819336:0:7628:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683361.819345:0:7628:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c432d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:08ddc492-5684-492d-ac6b-b8fd660301db+3:11164:x1876618815526528:12345-0@lo:104: 00010000:00010000:2.0:1789683361.819371:0:7628:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.819441:0:7628:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789683361.819448:0:7628:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c432d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:08ddc492-5684-492d-ac6b-b8fd660301db+3:11164:x1876618815526528:12345-0@lo:104: Request processed in 104us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.819454:0:7628:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789683361.819514:0:11164:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff33 expref: 12 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.819526:0:11164:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff33 expref: 12 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683361.819537:0:11164:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815526656:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683361.819587:0:11164:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe627c5180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683361.819607:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a33b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815526016:0@lo:104: 00000100:00100000:2.0:1789683361.819617:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a33100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815526144:0@lo:104: 00000100:00100000:2.0:1789683361.819623:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815526528:0@lo:104: 00010000:00010000:3.0:1789683361.820254:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683361.820262:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683361.820271:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2600 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683361.820274:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683361.820283:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683361.820305:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683361.820311:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789683361.820341:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683361.820348:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683361.820378:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683361.820386:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2600/0x59bee33f93fea06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea14 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683361.820413:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683361.820415:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683361.820417:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683361.820430:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815526784:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683361.820468:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683361.821379:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815525888:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683361.822186:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815526400 00000100:00100000:1.0:1789683361.822194:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815526400 00010000:00010000:1.0:1789683361.822234:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea1b expref: 19 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683361.822310:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815526272 00000100:00100000:1.0:1789683361.822314:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815526272 00010000:00010000:1.0:1789683361.822326:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea29 expref: 20 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683361.824162:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683361.824183:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+20:3305:x1876618815526400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683361.824202:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683361.824211:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea1b expref: 20 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.824225:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fea1b expref: 20 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.824246:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fea1b expref: 20 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.824262:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683361.824333:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815526400:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (9213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683361.824368:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789683361.824424:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683361.824430:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+18:3305:x1876618815526272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683361.824437:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683361.824442:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea29 expref: 18 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.824450:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fea29 expref: 18 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.824459:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8d000/0x59bee33f93fea30 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fea29 expref: 18 pid: 5823 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.824468:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683361.824491:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:08ddc492-5684-492d-ac6b-b8fd660301db+17:3305:x1876618815526272:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (9261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683361.824497:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789683361.833904:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683361.834154:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815526784 00000100:00100000:2.0:1789683361.834176:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815526784 00010000:00010000:2.0:1789683361.834222:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea06 expref: 17 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683361.834255:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789683361.834264:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+17:3302:x1876618815526784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683361.834277:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683361.834282:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea06 expref: 17 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.834293:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fea06 expref: 17 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.834309:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea8400/0x59bee33f93fea14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fea06 expref: 17 pid: 5821 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683361.834324:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683361.834392:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+16:3302:x1876618815526784:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (13923us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683361.834409:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683361.834758:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815526272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683361.834769:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815526400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683361.835383:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683361.835505:0:11164:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11164:1876618815526656:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683361.835536:0:11164:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683361.835717:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815526784:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683361.835839:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802905216 00000100:00100000:2.0:1789683361.835846:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802905216 00010000:00010000:2.0:1789683361.835873:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff6b expref: 13 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683361.835961:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802905344 00000100:00100000:1.0:1789683361.835965:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802905344 00010000:00010000:0.0:1789683361.836073:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff33 expref: 14 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683361.836096:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1789683361.836105:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+14:2352:x1876618802905216:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683361.836115:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683361.836131:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff6b expref: 14 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836142:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff6b expref: 14 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836156:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea8600/0x59bee33f93fea45 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff6b expref: 14 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836167:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683361.836220:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802905216:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 115us (2325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683361.836227:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1789683361.836243:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:0.0:1789683361.836249:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+12:2353:x1876618802905344:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683361.836257:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683361.836260:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff33 expref: 12 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836269:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff33 expref: 12 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836278:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9200/0x59bee33f93fea0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff33 expref: 12 pid: 5821 timeout: 395 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836288:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836296:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836314:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836322:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836328:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836335:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836341:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8c400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683361.836346:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836354:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836377:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.836386:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683361.836974:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+11:2353:x1876618802905344:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 722us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683361.836982:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00010000:00010000:0.0:1789683361.837020:0:11164:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.837028:0:11164:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683361.837041:0:11164:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fea61 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683362.335879:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683363.296163:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683363.296197:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815526912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683363.296274:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683363.296699:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815526912 00000100:00100000:0.0:1789683363.296708:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815526912 00000100:00100000:0.0:1789683363.296761:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789683363.296769:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815526912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683363.296803:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683363.296845:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815526912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683363.296852:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789683363.296992:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683363.297127:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760a1880 x1876618815526912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683363.297144:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815526912:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789683363.359739:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683363.359747:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe53b2b800 from 7 10000000:01000000:2.0:1789683363.359752:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683363.359792:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683363.359817:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683363.359829:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683363.359853:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683363.359920:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683363.359973:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815527040 00000100:00100000:2.0:1789683363.359979:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe627c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683363.359980:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815527040 00000100:00100000:3.0:1789683363.360030:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789683363.360039:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815527040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683363.360061:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683363.360087:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fea68 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.360109:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fea68 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.360120:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea68 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.360129:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9400, rc 0) 00000100:00100000:3.0:1789683363.360173:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815527040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683363.360179:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00010000:00010000:3.0:1789683363.360228:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683363.360258:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683363.360273:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683363.360281:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683363.360335:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683363.360374:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683363.360395:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe627c5240 going to sleep for 11 seconds 00000100:00100000:3.0:1789683363.360412:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815527168 00000100:00100000:3.0:1789683363.360416:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815527168 00000100:00100000:3.0:1789683363.360445:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789683363.360451:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815527168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683363.360702:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815527168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683363.360709:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789683363.362897:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe6fef1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683363.362962:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683363.363029:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683363.363077:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683363.363097:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815527296 00000100:00100000:3.0:1789683363.363110:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815527296 00000100:00100000:3.0:1789683363.363152:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789683363.363159:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815527296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683363.363334:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815527296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683363.363368:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789683363.363421:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789683363.365727:0:11202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789683363.365786:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789683363.365807:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789683363.365818:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683363.365830:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683363.365840:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789683363.365843:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe52f3c000 from 7 10000000:01000000:0.0:1789683363.365845:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683363.365881:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683363.365889:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683363.365906:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683363.365929:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683363.366162:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683363.366202:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b600 going to sleep for 11 seconds 00000100:00100000:3.0:1789683363.366204:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815527424 00000100:00100000:3.0:1789683363.366211:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815527424 00000100:00100000:3.0:1789683363.366248:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1789683363.366256:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815527424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683363.366270:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683363.366283:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fea76 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.366306:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fea76 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.366315:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea76 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.366323:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9c00, rc 0) 00000100:00100000:3.0:1789683363.366391:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815527424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683363.366397:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1789683363.366725:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683363.366739:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683363.366748:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683363.366794:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683363.366822:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683363.366840:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683363.367095:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815527552 00000100:00100000:1.0:1789683363.367101:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815527552 00000100:00100000:1.0:1789683363.367147:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789683363.367155:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815527552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683363.367454:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815527552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 300us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683363.367460:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789683363.367531:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683363.367562:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683363.367598:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683363.367620:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683363.367763:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815527680 00000100:00100000:1.0:1789683363.367767:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815527680 00000100:00100000:1.0:1789683363.367827:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789683363.367835:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815527680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683363.367975:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815527680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683363.367982:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789683363.368321:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789683363.369830:0:11203:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789683363.370062:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789683363.370081:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789683363.370091:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683363.370112:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683363.370123:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789683363.370125:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe46fc8800 from 7 10000000:01000000:0.0:1789683363.370127:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683363.370172:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683363.370188:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683363.370197:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683363.370217:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683363.370274:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683363.370319:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683363.370569:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815527808 00000100:00100000:2.0:1789683363.370576:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815527808 00000100:00100000:2.0:1789683363.370621:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789683363.370630:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815527808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683363.370644:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683363.370656:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93fea84 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683363.370717:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93fea84 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683363.370728:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea84 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683363.370737:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c800, rc 0) 00000100:00100000:2.0:1789683363.370779:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815527808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683363.370786:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789683363.371622:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683363.371640:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683363.371650:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683363.371733:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683363.371768:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683363.371810:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683363.371871:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815527936 00000100:00100000:2.0:1789683363.371876:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815527936 00000100:00100000:2.0:1789683363.371914:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789683363.371924:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815527936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683363.372454:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815527936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 530us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683363.372461:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1789683363.372527:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815527936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683363.372557:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815528064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683363.372596:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683363.372630:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683363.372701:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815528064 00000100:00100000:2.0:1789683363.372707:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815528064 00000100:00100000:2.0:1789683363.372732:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1789683363.372738:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815528064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683363.372868:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815528064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683363.372874:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789683363.372977:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815528064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789683363.373817:0:11204:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789683363.374158:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789683363.374183:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683363.374194:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.374213:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683363.555249:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683363.555323:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802905472 00000100:00100000:1.0:1789683363.555333:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802905472 00000100:00100000:1.0:1789683363.555391:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 248 00000100:00100000:1.0:1789683363.555401:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+11:5588:x1876618802905472:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683363.555420:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683363.555437:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449eff95 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683363.555477:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff95 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683363.555488:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff95 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683363.555496:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e2200, rc 0) 00000100:00100000:1.0:1789683363.555550:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802905472:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 150us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683363.555557:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 248 00000100:00100000:3.0:1789683363.557561:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683363.557626:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802905600 00000100:00100000:1.0:1789683363.557634:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802905600 00000100:00100000:1.0:1789683363.557707:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 249 00000100:00100000:1.0:1789683363.557715:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802905600:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683363.557965:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802905600:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 249us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683363.557972:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 249 00000100:00100000:1.0:1789683363.561822:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683363.561924:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802905728 00000100:00100000:2.0:1789683363.562169:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802905728 00000100:00100000:2.0:1789683363.562290:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 250 00000100:00100000:2.0:1789683363.562302:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802905728:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683363.562910:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802905728:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 608us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683363.562919:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 250 00000100:00100000:0.0:1789683363.572819:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683363.572895:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802905856 00000100:00100000:3.0:1789683363.572906:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802905856 00000100:00100000:3.0:1789683363.572961:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 251 00000100:00100000:3.0:1789683363.572971:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802905856:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683363.572987:0:5823:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683363.573005:0:5823:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449eff9c expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.573032:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff9c expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.573042:0:5823:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff9c expref: 13 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683363.573050:0:5823:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8200, rc 0) 00000100:00100000:3.0:1789683363.573121:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802905856:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 151us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683363.573128:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 251 00000100:00100000:0.0:1789683363.581567:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683363.581708:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802905984 00000100:00100000:3.0:1789683363.581718:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802905984 00000100:00100000:3.0:1789683363.581766:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 252 00000100:00100000:3.0:1789683363.581776:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802905984:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683363.582206:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802905984:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 430us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683363.582216:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 252 00000100:00100000:0.0:1789683363.585894:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683363.585968:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802906112 00000100:00100000:2.0:1789683363.585977:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802906112 00000100:00100000:2.0:1789683363.586058:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 253 00000100:00100000:2.0:1789683363.586082:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802906112:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683363.586298:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802906112:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 218us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683363.586314:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 253 00010000:00010000:3.0:1789683364.385914:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683365.035895:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683365.035922:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683365.035951:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683365.035979:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802906368 00000100:00100000:3.0:1789683365.035987:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802906368 00000100:00100000:2.0:1789683365.036233:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802906496 00000100:00100000:2.0:1789683365.036238:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802906496 00000100:00100000:2.0:1789683365.036314:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:2.0:1789683365.036324:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802906496:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683365.036403:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802906496:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 81us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683365.036410:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00080000:2.0:1789683365.036430:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683365.036973:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:3.0:1789683365.036980:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802906368:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683365.037026:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802906368:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683365.037032:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00080000:2.0:1789683365.039110:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683365.039192:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802906240 00000100:00100000:1.0:1789683365.039204:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802906240 00000100:00100000:1.0:1789683365.039451:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 254 00000100:00100000:1.0:1789683365.039462:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802906240:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683365.039666:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802906240:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 206us (3779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683365.041056:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 254 00000100:00100000:1.0:1789683365.344255:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815528448:0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.344356:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683365.344422:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815528960:0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.344450:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683365.344619:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815528448 00000100:00100000:0.0:1789683365.344627:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815528448 00000100:00100000:0.0:1789683365.344693:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789683365.344703:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815528448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683365.344856:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815528320:0@lo:400:kworker.0 00000100:00100000:0.0:1789683365.347617:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815528448:12345-0@lo:400:kworker.0 Request processed in 2906us (3252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683365.347632:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1789683365.348629:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815528448:0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.348663:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815528576:0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.348724:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683365.349189:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815528192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683365.349215:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683365.349456:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683365.349474:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815528704:0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.349504:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683365.349535:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815528960 00000100:00100000:1.0:1789683365.349542:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815528960 00000100:00100000:1.0:1789683365.349588:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815528704 00000100:00100000:1.0:1789683365.349591:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815528704 00000100:00100000:1.0:1789683365.349613:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789683365.349621:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815528960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.349689:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815528960:12345-0@lo:400:kworker.0 Request processed in 52us (5221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683365.349696:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789683365.349711:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789683365.349717:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815528704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.351114:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815528704:12345-0@lo:400:kworker.0 Request processed in 1392us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683365.351135:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789683365.351172:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815528576 00000100:00100000:1.0:1789683365.351180:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815528576 00000100:00100000:1.0:1789683365.351224:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789683365.351232:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815528576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.352132:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815528576:12345-0@lo:400:kworker.0 Request processed in 59us (2565us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683365.352141:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1789683365.352170:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683365.352175:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683365.352178:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683365.353367:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683365.353403:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815528320 00000100:00100000:3.0:1789683365.353410:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815528320 00000100:00100000:3.0:1789683365.353460:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789683365.353468:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815528320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683365.353516:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815528320:12345-0@lo:400:kworker.0 Request processed in 48us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683365.353523:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00010000:00080000:1.0:1789683365.353537:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760a0000 x1876618815528704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683365.353553:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815528704:0@lo:400:kworker.0 00000100:00100000:3.0:1789683365.353647:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815528320:0@lo:400:kworker.0 00010000:00080000:1.0:1789683365.353648:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760a3800 x1876618815528960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683381 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683365.353658:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815528832:0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.353658:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815528960:0@lo:400:kworker.0 00000100:00100000:1.0:1789683365.353701:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815528576:0@lo:400:kworker.0 00000100:00100000:0.0:1789683365.359385:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815528192 00000100:00100000:0.0:1789683365.359400:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815528192 00000100:00100000:0.0:1789683365.359525:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789683365.359536:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815528192:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683365.359544:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:0.0:1789683365.359577:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683365.359591:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815528832 00000100:00100000:3.0:1789683365.359599:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815528832 00000100:00100000:0.0:1789683365.359638:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815528192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (10421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683365.359646:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789683365.359649:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789683365.359660:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815528832:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1789683365.359725:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76c20000 x1876618815528192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683365.359738:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815528832:12345-0@lo:400:kworker.0 Request processed in 79us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683365.359748:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789683365.359751:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815528192:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1789683365.359771:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683365.359801:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815528832:0@lo:400:kworker.0 00010000:00010000:1.0:1789683365.407847:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683366.304411:0:11362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789683366.437883:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683367.458469:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683368.423301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815529088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683368.423384:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683368.423714:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815529088 00000100:00100000:0.0:1789683368.423722:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815529088 00000100:00100000:0.0:1789683368.423775:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789683368.423784:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815529088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683368.423819:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683368.423868:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815529088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683368.423875:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1789683368.423917:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760a0e00 x1876618815529088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683368.423933:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815529088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789683368.424226:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789683368.483507:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683369.506790:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683370.151180:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683370.151234:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683370.151279:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683370.151320:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802906624 00000100:00100000:2.0:1789683370.151330:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802906624 00000100:00100000:2.0:1789683370.151605:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 256 00000100:00100000:2.0:1789683370.151614:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802906624:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683370.151703:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802906624:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 90us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.151711:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 256 00000100:00100000:2.0:1789683370.151760:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802906752 00000100:00100000:2.0:1789683370.151764:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802906752 00000100:00100000:2.0:1789683370.151791:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802906880 00000100:00100000:2.0:1789683370.151794:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802906880 00000100:00100000:2.0:1789683370.151814:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1789683370.151822:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802906752:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683370.152101:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802906752:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 279us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.152108:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:2.0:1789683370.152121:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:2.0:1789683370.152128:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802906880:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683370.152152:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802906880:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 25us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.152158:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00080000:3.0:1789683370.152690:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683370.467555:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815529216:0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.467635:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.467699:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815529728:0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.467728:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.467754:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789683370.467760:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815529344:0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.467781:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.467807:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815529856:0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.467829:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683370.467854:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815529728 00000100:00100000:0.0:1789683370.467854:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815529472:0@lo:400:kworker.0 00000100:00100000:2.0:1789683370.467862:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815529728 00000100:00100000:0.0:1789683370.467886:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683370.467903:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815529984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683370.467913:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815529344 00000100:00100000:2.0:1789683370.467916:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815529344 00000100:00100000:0.0:1789683370.467923:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683370.467933:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815529472 00000100:00100000:2.0:1789683370.467936:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815529472 00000100:00100000:0.0:1789683370.467939:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683370.467944:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815529600:0@lo:400:kworker.0 00000100:00100000:2.0:1789683370.467952:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789683370.467962:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815529728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.467964:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683370.468021:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815529728:12345-0@lo:400:kworker.0 Request processed in 60us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.468028:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789683370.468045:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789683370.468050:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815529344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683370.468073:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815529344:12345-0@lo:400:kworker.0 Request processed in 23us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.468078:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789683370.468087:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789683370.468093:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815529472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683370.468137:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815529472:12345-0@lo:400:kworker.0 Request processed in 44us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683370.468144:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1789683370.468164:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683370.468617:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815529216 00000100:00100000:0.0:1789683370.468622:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815529216 00000100:00100000:0.0:1789683370.468769:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789683370.468778:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815529216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.468816:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49750450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815529216:12345-0@lo:400:kworker.0 Request processed in 41us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.468823:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789683370.468855:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815529856 00000100:00100000:0.0:1789683370.468859:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815529856 00000100:00100000:0.0:1789683370.468894:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815529600 00000100:00100000:0.0:1789683370.468897:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815529600 00000100:00100000:0.0:1789683370.468924:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789683370.468932:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815529856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683370.468941:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789683370.468954:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815529600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.468968:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815529856:12345-0@lo:400:kworker.0 Request processed in 37us (1136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.468988:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683370.469004:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815529600:12345-0@lo:400:kworker.0 Request processed in 52us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.469017:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815529984 00000100:00100000:0.0:1789683370.469021:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815529984 00000100:00100000:1.0:1789683370.469033:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789683370.469048:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789683370.469055:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815529984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683370.469079:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789683370.469134:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683370.469137:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683370.469579:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815529984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 523us (1653us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683370.469593:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:0.0:1789683370.469713:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760a1180 x1876618815529600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683370.469728:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815529600:0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.469743:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815529472:0@lo:400:kworker.0 00010000:00080000:0.0:1789683370.469753:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe48a5ca80 x1876618815529984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683370.469768:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815529984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683370.469836:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815529344:0@lo:400:kworker.0 00010000:00080000:0.0:1789683370.469847:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760a0700 x1876618815529856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683386 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683370.469855:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815529856:0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.469864:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815529216:0@lo:400:kworker.0 00000100:00100000:0.0:1789683370.469873:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815529728:0@lo:400:kworker.0 00010000:00010000:3.0:1789683370.546127:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683370.847453:0:11461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:16:09 (1789683369) === 00000100:00100000:3.0:1789683371.089498:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683371.089543:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683371.089563:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802907008 00000100:00100000:2.0:1789683371.089576:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802907008 00000100:00100000:2.0:1789683371.089649:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1789683371.089660:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802907008:12345-192.168.203.60@tcp:41:mkdir.0 00000004:00000024:2.0:1789683371.089744:0:9827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1789683371.089830:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802907008:12345-192.168.203.60@tcp:41:mkdir.0 Request processed in 172us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683371.089838:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1789683371.093958:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802907136 00000100:00100000:1.0:1789683371.093972:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802907136 00000100:00100000:1.0:1789683371.094240:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1789683371.094620:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:9676:x1876618802907136:12345-192.168.203.60@tcp:700:mkdir.0 00000100:00100000:1.0:1789683371.094739:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:9676:x1876618802907136:12345-192.168.203.60@tcp:700:mkdir.0 Request processed in 126us (5196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.094746:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1789683371.098925:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683371.099087:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802907392 00000100:00100000:2.0:1789683371.099107:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802907392 00000100:00100000:2.0:1789683371.099215:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1789683371.099226:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:9676:x1876618802907392:12345-192.168.203.60@tcp:36:mkdir.0 00010000:00010000:2.0:1789683371.099304:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683371.099332:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fe981 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff1e expref: 6 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.099351:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931ed00) 00010000:00010000:2.0:1789683371.099363:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683371.099754:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.099767:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.099777:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.099838:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.099847:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.099854:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683371.103963:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789683371.103983:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.103995:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.104029:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.104035:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8c600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683371.104040:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.104048:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.104064:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c700) 00010000:00010000:2.0:1789683371.104067:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683371.104071:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.104078:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaa0 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683371.104096:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006ed6e391 reply state 0000000061430e41 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683371.104106:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683371.104197:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:9676:x1876618802907392:12345-192.168.203.60@tcp:36:mkdir.0 Request processed in 4969us (5277us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789683371.104206:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00010000:00010000:2.0:1789683371.106725:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.106742:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.106766:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.106771:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683371.106776:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.106783:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.106797:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683371.106800:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683371.106804:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.106811:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feaa7 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683371.113171:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683371.115546:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802907520 00000100:00100000:0.0:1789683371.115564:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802907520 00000100:00100000:0.0:1789683371.115640:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1789683371.115652:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:9677:x1876618802907520:12345-192.168.203.60@tcp:101:chmod.0 00010000:00010000:0.0:1789683371.115701:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683371.115934:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93feaae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effa3 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.116029:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feab5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.116043:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.116055:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683371.116093:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789683371.116097:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683371.116137:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feab5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.116164:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93feaae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effa3 expref: 8 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.116182:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feab5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effa3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.116189:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe60aa2100) 00010000:00010000:0.0:1789683371.116192:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683371.116196:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ee00, rc 0) 00000100:00100000:0.0:1789683371.116270:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:9677:x1876618802907520:12345-192.168.203.60@tcp:101:chmod.0 Request processed in 620us (3108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683371.116277:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1789683371.125971:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683371.127104:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802907776 00000100:00100000:2.0:1789683371.127116:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802907776 00000100:00100000:2.0:1789683371.127183:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1789683371.127194:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:9677:x1876618802907776:12345-192.168.203.60@tcp:36:chmod.0 00010000:00010000:2.0:1789683371.127249:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683371.127274:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feab5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effa3 expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.127308:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe60aa2100) 00010000:00010000:2.0:1789683371.127320:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683371.127357:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.127370:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.127381:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683371.127663:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000aa90e9e4 reply state 0000000023c3e4b7 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683371.127732:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789683371.127740:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789683371.127826:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:9677:x1876618802907776:12345-192.168.203.60@tcp:36:chmod.0 Request processed in 633us (1863us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1789683371.127834:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00010000:00010000:0.0:1789683371.131134:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.131156:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.131164:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.131169:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683371.131174:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.131182:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.131198:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:0.0:1789683371.131201:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789683371.131206:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.131213:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feabc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683371.157191:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683371.157375:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802907904 00000100:00100000:2.0:1789683371.157388:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802907904 00000100:00100000:2.0:1789683371.157482:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1789683371.157494:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:9678:x1876618802907904:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1789683371.157520:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683371.157544:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effaa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.157609:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8de00/0x59bee33f93feaca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.157642:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8de00/0x59bee33f93feaca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.157719:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8de00/0x59bee33f93feaca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683371.160789:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683371.160802:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683371.160875:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8de00/0x59bee33f93feaca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.160919:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effaa expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.160943:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8de00/0x59bee33f93feaca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effaa expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.160952:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c700) 00010000:00010000:2.0:1789683371.160955:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683371.160959:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8de00, rc 0) 00000100:00100000:2.0:1789683371.161024:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:9678:x1876618802907904:12345-192.168.203.60@tcp:101:chown.0 Request processed in 3532us (3840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683371.161032:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1789683371.176424:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683371.180497:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802908032 00000100:00100000:2.0:1789683371.180514:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802908032 00000100:00100000:2.0:1789683371.180641:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:2.0:1789683371.180652:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:9678:x1876618802908032:12345-192.168.203.60@tcp:101:chown.0 00010000:00010000:2.0:1789683371.180712:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683371.180734:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fead1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effb1 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.180837:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.180852:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.180863:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.180878:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.180886:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.180893:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.180979:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c400/0x59bee33f93feae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.180988:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c400/0x59bee33f93feae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.180995:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c400/0x59bee33f93feae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683371.181025:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683371.181028:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683371.181052:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c400/0x59bee33f93feae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181076:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181082:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181090:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181096:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683371.181100:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181108:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181120:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c700) 00010000:00010000:2.0:1789683371.181123:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683371.181128:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181135:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fead8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181146:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181151:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181157:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181168:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8da00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683371.181171:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181178:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181186:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dbe6097c500) 00010000:00010000:2.0:1789683371.181188:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683371.181191:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181197:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93feadf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181229:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fead1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effb1 expref: 10 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181244:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c400/0x59bee33f93feae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effb1 expref: 9 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.181265:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:2.0:1789683371.181267:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683371.181270:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c400, rc 0) 00000100:00100000:2.0:1789683371.181352:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:9678:x1876618802908032:12345-192.168.203.60@tcp:101:chown.0 Request processed in 701us (4939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683371.181359:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:1.0:1789683371.186378:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683371.186611:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802908288 00000100:00100000:0.0:1789683371.186623:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802908288 00000100:00100000:1.0:1789683371.186935:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1789683371.186947:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:9678:x1876618802908288:12345-192.168.203.60@tcp:36:chown.0 00010000:00010000:1.0:1789683371.186998:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683371.187024:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c400/0x59bee33f93feae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effb1 expref: 9 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.187042:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:1.0:1789683371.187052:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683371.187076:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.187203:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.187214:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683371.224656:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051430fe0 reply state 00000000b85ee625 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683371.224713:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789683371.224728:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789683371.224847:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:9678:x1876618802908288:12345-192.168.203.60@tcp:36:chown.0 Request processed in 37899us (38473us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789683371.224856:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000001:00080000:0.0:1789683371.225023:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1789683371.225960:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.225974:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.225982:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.225989:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683371.225995:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.226004:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.226445:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe46df9a00) 00010000:00010000:2.0:1789683371.226448:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789683371.226454:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.226461:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feaed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683371.244844:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683371.245015:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802908416 00000100:00100000:2.0:1789683371.245039:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802908416 00000100:00100000:2.0:1789683371.245093:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1789683371.245104:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:9679:x1876618802908416:12345-192.168.203.60@tcp:101:touch.500 00010000:00010000:2.0:1789683371.245131:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683371.245159:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effb8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683371.253317:0:5829:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 8102us 00010000:00010000:3.0:1789683371.275970:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.275996:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276021:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276039:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276047:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276054:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276418:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feb09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276428:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276435:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683371.276455:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789683371.276458:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683371.276492:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feb09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276502:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276509:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276525:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276531:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683371.276536:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276543:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276555:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c700) 00010000:00010000:3.0:1789683371.276558:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683371.276562:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276569:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feafb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276579:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276585:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276590:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276595:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683371.276598:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276610:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276618:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dbe5931e300) 00010000:00010000:3.0:1789683371.276620:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683371.276623:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276628:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb02 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276659:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93feaf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effb8 expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276696:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feb09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effb8 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.276704:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe5931e800) 00010000:00010000:3.0:1789683371.276706:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789683371.276709:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9200, rc 0) 00000100:00100000:3.0:1789683371.276927:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:9679:x1876618802908416:12345-192.168.203.60@tcp:101:touch.500 Request processed in 31823us (32092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683371.276936:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1789683371.289603:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683371.289839:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802908672 00000100:00100000:2.0:1789683371.289851:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802908672 00000100:00100000:3.0:1789683371.290020:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1789683371.290032:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:9679:x1876618802908672:12345-192.168.203.60@tcp:101:touch.500 00010000:00010000:3.0:1789683371.290053:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683371.290072:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb10 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effbf expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.290482:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.290498:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.290510:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.290565:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.290572:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.290579:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683371.292085:0:9827:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1789683371.292464:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93feb25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292479:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93feb25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292490:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93feb25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292527:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292543:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292550:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292558:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683371.292562:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292569:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292581:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe5931e800) 00010000:00010000:3.0:1789683371.292585:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683371.292589:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292595:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feb17 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683371.292609:0:9827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000200cd82 reply state 00000000cc7b2aa1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683371.292618:0:9827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789683371.292654:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93feb10 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effbf expref: 10 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292668:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93feb25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effbf expref: 9 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.292881:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dbe5931e200) 00010000:00010000:3.0:1789683371.292884:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683371.292887:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8400, rc 0) 00000100:00100000:3.0:1789683371.292954:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:9679:x1876618802908672:12345-192.168.203.60@tcp:101:touch.500 Request processed in 2924us (3361us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789683371.292964:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1789683371.306588:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:3.0:1789683371.306622:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.306634:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.306643:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.306650:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683371.306655:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.306663:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.306696:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff8dbe5931e300) 00010000:00010000:3.0:1789683371.306700:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683371.306705:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.306711:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93feb1e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683371.306766:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802908928 00000100:00100000:3.0:1789683371.306776:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802908928 00000100:00100000:3.0:1789683371.306820:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1789683371.306829:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:9679:x1876618802908928:12345-192.168.203.60@tcp:36:touch.500 00010000:00010000:3.0:1789683371.306883:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683371.306899:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93feb25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effbf expref: 9 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.306910:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dbe5931e200) 00010000:00010000:3.0:1789683371.306917:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683371.306958:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.306970:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.306980:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683371.307119:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cadc188 reply state 00000000f0a610a5 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683371.307129:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683371.307230:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:9679:x1876618802908928:12345-192.168.203.60@tcp:36:touch.500 Request processed in 401us (651us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789683371.307238:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00010000:00010000:2.0:1789683371.309722:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.309741:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.309824:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.309833:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683371.309837:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.309846:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.309861:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:2.0:1789683371.309864:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683371.309869:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.309875:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93feb33 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683371.311173:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683371.311260:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802909056 00000100:00100000:0.0:1789683371.311271:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802909056 00000100:00100000:0.0:1789683371.311334:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:0.0:1789683371.311345:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:9679:x1876618802909056:12345-192.168.203.60@tcp:101:touch.500 00010000:00010000:0.0:1789683371.311385:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683371.311407:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93feb3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effc6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.311468:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93feb3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effc6 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.311484:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93feb3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effc6 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.311505:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dbe60aa2000) 00010000:00010000:0.0:1789683371.311509:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683371.311512:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e400, rc 0) 00000100:00100000:0.0:1789683371.311577:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:9679:x1876618802909056:12345-192.168.203.60@tcp:101:touch.500 Request processed in 234us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683371.311585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:3.0:1789683371.314167:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683371.314307:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802909184 00000100:00100000:0.0:1789683371.314319:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802909184 00000100:00100000:0.0:1789683371.314365:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1789683371.314375:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876618802909184:12345-192.168.203.60@tcp:8:touch.500 00010000:00080000:0.0:1789683371.314410:0:6677:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp t0 exp 0000000000000000 cur 304 last 0 00000020:00000080:0.0:1789683371.314442:0:6677:0:(genops.c:1384:class_connect()) connect: client 54d6ac2c-8152-4eed-adb8-5b5d9e80a202, cookie 0x59bee33f93feb41 00002000:00100000:0.0:1789683371.314456:0:6677:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 54d6ac2c-8152-4eed-adb8-5b5d9e80a202/ffff8dbe7bfb9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789683371.314469:0:6677:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789683371.314855:0:6677:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789683371.314886:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8dbe52f3c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683371.314966:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2351:x1876618802909184:12345-192.168.203.60@tcp:8:touch.500 Request processed in 591us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683371.314975:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:3.0:1789683371.317595:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683371.317700:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802909312 00000100:00100000:1.0:1789683371.317712:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802909312 00000100:00100000:1.0:1789683371.317778:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1789683371.317788:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:0:x1876618802909312:12345-192.168.203.60@tcp:2:touch.500 00000100:00080000:2.0:1789683371.317836:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1789683371.411555:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000001:00080000:3.0:1789683371.411573:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1789683371.411846:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:0:x1876618802909312:12345-192.168.203.60@tcp:2:touch.500 Request processed in 94053us (94253us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789683371.411858:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1789683371.414429:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683371.414525:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802909568 00000100:00100000:1.0:1789683371.414545:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802909568 00000100:00100000:1.0:1789683371.414605:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1789683371.414616:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:9679:x1876618802909568:12345-192.168.203.60@tcp:35:touch.500 00000100:00100000:1.0:1789683371.415166:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:9679:x1876618802909568:12345-192.168.203.60@tcp:35:touch.500 Request processed in 550us (742us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789683371.415174:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1789683371.437724:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683371.439152:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802909696 00000100:00100000:1.0:1789683371.439167:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802909696 00000100:00100000:1.0:1789683371.439240:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1789683371.439261:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:9680:x1876618802909696:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:1.0:1789683371.439407:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683371.439432:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93feb48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effcd expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.439513:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feb4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.439527:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feb4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.439717:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feb4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683371.439872:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789683371.439877:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789683371.439918:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feb4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.439946:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93feb48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effcd expref: 13 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.439965:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feb4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effcd expref: 12 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.439973:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe5931e800) 00010000:00010000:1.0:1789683371.439975:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683371.439979:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e3c00, rc 0) 00000100:00100000:1.0:1789683371.440717:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:9680:x1876618802909696:12345-192.168.203.60@tcp:101:rm.0 Request processed in 1412us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.440726:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1789683371.463512:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683371.463761:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802909952 00000100:00100000:0.0:1789683371.463771:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802909952 00000100:00100000:0.0:1789683371.463830:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1789683371.463839:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:9680:x1876618802909952:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:0.0:1789683371.463859:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683371.463879:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93feb56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effd4 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683371.463965:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789683371.464112:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93feb56 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effd4 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.464125:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c700) 00010000:00010000:0.0:1789683371.464128:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683371.464134:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93feb56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effd4 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683371.464149:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f000, rc 0) 00000100:00100000:0.0:1789683371.464205:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:9680:x1876618802909952:12345-192.168.203.60@tcp:101:rm.0 Request processed in 367us (702us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789683371.464213:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1789683371.494250:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683371.494596:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802910080 00000100:00100000:3.0:1789683371.494605:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802910080 00000100:00100000:3.0:1789683371.494659:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1789683371.494691:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:9680:x1876618802910080:12345-192.168.203.60@tcp:37:rm.0 00000100:00100000:3.0:1789683371.503220:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:9680:x1876618802910080:12345-192.168.203.60@tcp:37:rm.0 Request processed in 8534us (8965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683371.503238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1789683371.531807:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683371.533716:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802910336 00000100:00100000:3.0:1789683371.533733:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802910336 00000100:00100000:3.0:1789683371.533937:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1789683371.533949:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe708a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:9680:x1876618802910336:12345-192.168.203.60@tcp:35:rm.0 00000100:00100000:3.0:1789683371.534216:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe708a1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:9680:x1876618802910336:12345-192.168.203.60@tcp:35:rm.0 Request processed in 268us (2424us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1789683371.534223:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1789683371.542958:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683371.544424:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802910592 00000100:00100000:2.0:1789683371.544440:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802910592 00000100:00100000:2.0:1789683371.544511:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1789683371.544523:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:9680:x1876618802910592:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:2.0:1789683371.544546:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683371.544568:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93feb64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effdb expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.544662:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feb6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.544715:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feb6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.544729:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feb6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683371.544741:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789683371.545139:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93feb64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effdb expref: 17 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.545158:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feb6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effdb expref: 16 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.545177:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe5931e800) 00010000:00010000:2.0:1789683371.545181:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683371.545185:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d600, rc 0) 00000100:00100000:2.0:1789683371.545661:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:9680:x1876618802910592:12345-192.168.203.60@tcp:101:rm.0 Request processed in 1136us (2718us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789683371.545715:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00010000:00010000:1.0:1789683371.553258:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683371.557233:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683371.557371:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802910720 00000100:00100000:1.0:1789683371.557388:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802910720 00000100:00100000:1.0:1789683371.557580:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:1.0:1789683371.557593:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:9680:x1876618802910720:12345-192.168.203.60@tcp:41:rm.0 00000004:00000024:1.0:1789683371.557854:0:9827:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1789683371.558332:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:9680:x1876618802910720:12345-192.168.203.60@tcp:41:rm.0 Request processed in 738us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683371.558342:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1789683371.561232:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683371.561401:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802910848 00000100:00100000:3.0:1789683371.561414:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802910848 00000100:00100000:3.0:1789683371.561742:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1789683371.561756:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:9680:x1876618802910848:12345-192.168.203.60@tcp:101:rm.0 00010000:00010000:3.0:1789683371.561851:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683371.561946:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effe2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562126:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562146:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562160:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562177:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562183:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562190:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562532:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93feb8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562542:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93feb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562550:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93feb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683371.562591:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789683371.562596:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683371.562621:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93feb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562648:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93feb8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562659:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562666:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562698:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562705:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44430600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683371.562711:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562720:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562734:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe5931e800) 00010000:00010000:3.0:1789683371.562737:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683371.562743:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562750:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feb80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562896:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562905:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562922:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562927:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44431e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683371.562930:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562937:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562946:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff8dbe5931e200) 00010000:00010000:3.0:1789683371.562949:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683371.562953:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.562958:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.563013:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effe2 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.563031:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93feb8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effe2 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.563039:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dbe60aa2000) 00010000:00010000:3.0:1789683371.563042:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683371.563045:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe44430400, rc 0) 00000100:00100000:3.0:1789683371.563189:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:9680:x1876618802910848:12345-192.168.203.60@tcp:101:rm.0 Request processed in 1436us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683371.563208:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:2.0:1789683371.573431:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683371.574341:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802911104 00000100:00100000:3.0:1789683371.574359:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802911104 00000100:00100000:3.0:1789683371.574438:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1789683371.574450:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:9680:x1876618802911104:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:3.0:1789683371.575027:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789683371.575065:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93feb8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effe2 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575094:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93feb3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effc6 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575108:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dbe60aa2000) 00010000:00010000:3.0:1789683371.575127:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93feb4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effcd expref: 15 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575137:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe5931e800) 00010000:00010000:3.0:1789683371.575141:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683371.575170:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575186:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575197:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575212:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575238:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575246:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575388:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575396:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.575403:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683371.578337:0:6698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1789683371.578357:0:6698:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 305209683081ns, next at 306209678227ns, rc = 0 00010000:00010000:2.0:1789683371.578551:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.578573:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.578589:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.579549:0:6698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.579565:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.579572:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.579629:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683371.579663:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.579669:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.579824:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683371.579832:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.579858:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.581580:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8c600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683371.581595:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.581611:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581642:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44430600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683371.581643:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dbe5931e300) 00010000:00010000:3.0:1789683371.581646:0:7626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789683371.581652:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.581653:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581661:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581739:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8dbe5931e300) 00010000:00010000:2.0:1789683371.581742:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789683371.581746:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581755:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93feba3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581799:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581807:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581815:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581835:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44431600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683371.581839:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581844:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581854:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe5931e800) 00010000:00010000:2.0:1789683371.581856:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683371.581859:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.581865:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93feb95 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683371.581880:0:6698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c8838146 reply state 0000000058fcee72 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683371.581891:0:6698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789683371.581947:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93febaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683371.582108:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:9680:x1876618802911104:12345-192.168.203.60@tcp:36:rm.0 Request processed in 7646us (8679us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789683371.582119:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00010000:00010000:3.0:1789683371.586588:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.586613:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.586623:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.586640:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44431e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683371.586646:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.586656:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.586743:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xa178ae45 (ffff8dbe5931e200) 00010000:00010000:3.0:1789683371.586748:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683371.586754:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683371.586950:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431e00/0x59bee33f93feb9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xa178ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683371.587882:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683371.588344:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802911360 00000100:00100000:3.0:1789683371.588359:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802911360 00000100:00100000:3.0:1789683371.588427:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1789683371.588441:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:9680:x1876618802911360:12345-192.168.203.60@tcp:35:rm.0 00010000:00010000:0.0:1789683371.589231:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683371.589236:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683371.589239:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683371.589347:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:9680:x1876618802911360:12345-192.168.203.60@tcp:35:rm.0 Request processed in 905us (1469us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789683371.589365:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1789683371.593810:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683371.594014:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802911616 00000100:00100000:1.0:1789683371.594030:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802911616 00000100:00100000:1.0:1789683371.594112:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:1.0:1789683371.594125:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:9680:x1876618802911616:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:1.0:1789683371.594203:0:9827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789683371.594239:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feb6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effdb expref: 16 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.594265:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feb09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effb8 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.594279:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe5931e800) 00010000:00010000:1.0:1789683371.594310:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8de00/0x59bee33f93feaca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effaa expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.594320:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c700) 00010000:00010000:1.0:1789683371.594328:0:9827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683371.594360:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.594376:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.594386:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.594420:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.594428:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.594435:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.595064:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.595076:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.595084:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683371.596640:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789683371.596670:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596840:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596848:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596855:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683371.596861:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596884:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596904:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8dbe46df9b00) 00010000:00010000:1.0:1789683371.596907:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1789683371.596914:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596920:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3c00/0x59bee33f93febbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596954:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596961:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596967:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596971:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683371.596974:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596979:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.596988:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe46df9d00) 00010000:00010000:1.0:1789683371.596990:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683371.596993:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683371.597010:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93febb1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683371.597026:0:9827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000030560e87 reply state 0000000094319df6 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683371.597035:0:9827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683371.597255:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:9680:x1876618802911616:12345-192.168.203.60@tcp:36:rm.0 Request processed in 3128us (3454us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789683371.597265:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00010000:00010000:2.0:1789683371.599535:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.599579:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.599588:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.599594:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683371.599600:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.599608:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.599626:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8dbe46df9c00) 00010000:00010000:2.0:1789683371.599629:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683371.599636:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683371.599641:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93febb8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683372.576690:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683373.537962:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815530112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683373.538031:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683373.538108:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815530112 00000100:00100000:1.0:1789683373.538115:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815530112 00000100:00100000:1.0:1789683373.538170:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789683373.538179:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815530112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683373.538215:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683373.538258:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815530112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683373.538265:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:1.0:1789683373.538301:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789683373.538332:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76c23b80 x1876618815530112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683373.538352:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815530112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683373.599955:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683374.625313:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683375.267270:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683375.267535:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802911744 00000100:00100000:3.0:1789683375.267546:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802911744 00000100:00100000:3.0:1789683375.267609:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 258 00000100:00100000:3.0:1789683375.267619:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802911744:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683375.268289:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802911744:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 669us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683375.268297:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 258 00000100:00100000:2.0:1789683375.268367:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683375.268612:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802912000 00000100:00100000:3.0:1789683375.268618:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802912000 00000100:00100000:3.0:1789683375.268689:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:3.0:1789683375.268698:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802912000:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683375.268738:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802912000:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 41us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683375.268744:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00080000:0.0:1789683375.268811:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683375.268978:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683375.269020:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683375.269070:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802911872 00000100:00100000:0.0:1789683375.269075:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802911872 00000100:00100000:0.0:1789683375.269108:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802912128 00000100:00100000:0.0:1789683375.269112:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802912128 00000100:00100000:0.0:1789683375.269131:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:0.0:1789683375.269138:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:2353:x1876618802911872:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683375.269217:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:3.0:1789683375.269226:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802912128:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683375.269724:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:2353:x1876618802911872:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 584us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683375.269732:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00080000:0.0:1789683375.269755:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683375.269980:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802912128:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 755us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683375.269988:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000004:00080000:2.0:1789683375.584291:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 309215615371ns, next at 310215612942ns, rc = 0 00000100:00100000:3.0:1789683375.584318:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815530240:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683375.584389:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683375.584486:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815530240 00000100:00100000:3.0:1789683375.584495:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815530240 00000100:00100000:3.0:1789683375.584577:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789683375.584587:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815530240:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789683375.584607:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1789683375.584633:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683375.584704:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815530240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683375.584711:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:0.0:1789683375.584783:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76a19500 x1876618815530240/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683375.584803:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815530240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683375.585266:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683375.585277:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815530368:0@lo:400:kworker.0 00000100:00100000:3.0:1789683375.585278:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683375.585323:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815530624:0@lo:400:kworker.0 00000100:00100000:1.0:1789683375.585374:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815530880:0@lo:400:kworker.0 00000100:00100000:3.0:1789683375.585425:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683375.585509:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815530496:0@lo:400:kworker.0 00000100:00100000:3.0:1789683375.585547:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683375.585577:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815530624 00000100:00100000:3.0:1789683375.585582:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815530624 00000100:00100000:3.0:1789683375.585618:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815530496 00000100:00100000:3.0:1789683375.585621:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815530496 00000100:00100000:3.0:1789683375.585641:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789683375.585648:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815530624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683375.585707:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815530624:12345-0@lo:400:kworker.0 Request processed in 58us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683375.585713:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789683375.585727:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789683375.585733:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815530496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683375.585778:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815530496:12345-0@lo:400:kworker.0 Request processed in 45us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683375.585784:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1789683375.585806:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683375.585817:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683375.585825:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815530624:0@lo:400:kworker.0 00000100:00100000:3.0:1789683375.585834:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815530496:0@lo:400:kworker.0 00000100:00100000:0.0:1789683375.585844:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815530752:0@lo:400:kworker.0 00000100:00100000:0.0:1789683375.585869:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683375.585895:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815530368 00000100:00100000:0.0:1789683375.585899:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815530368 00000100:00100000:0.0:1789683375.585923:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789683375.585929:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815530368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683375.585961:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49753c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815530368:12345-0@lo:400:kworker.0 Request processed in 33us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683375.585967:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1789683375.586003:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815530752 00000100:00100000:0.0:1789683375.586011:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815530752 00000100:00100000:0.0:1789683375.586039:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789683375.586045:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815530752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683375.586075:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815530752:12345-0@lo:400:kworker.0 Request processed in 30us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683375.586081:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789683375.586106:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c432680 x1876618815530752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683391 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683375.586116:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815530752:0@lo:400:kworker.0 00000100:00100000:0.0:1789683375.586125:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815530368:0@lo:400:kworker.0 00000100:00080000:3.0:1789683375.586139:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683375.586232:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683375.586525:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815530880 00000100:00100000:1.0:1789683375.586530:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815530880 00000100:00100000:1.0:1789683375.586635:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1789683375.586642:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815530880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683375.586700:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815530880:12345-0@lo:400:kworker.0 Request processed in 58us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683375.586706:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789683375.586707:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815530880:0@lo:400:kworker.0 00000100:00080000:2.0:1789683375.587017:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789683375.650027:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789683375.762452:0:11611:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:1.0:1789683376.673889:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789683376.730349:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967303 is committed 00000001:00080000:0.0:1789683376.730376:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1789683376.730391:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:0.0:1789683376.730410:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789683376.730669:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683376.730722:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815531008:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789683376.730801:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683376.730866:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815531008 00000100:00100000:3.0:1789683376.730874:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815531008 00000100:00100000:3.0:1789683376.730926:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683376.730936:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815531008:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789683376.730966:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1789683376.731000:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aac66ab, atime: 0x6aac66ab, ctime: 0x6aac66ab, blocks: 0x1 00010000:00010000:3.0:1789683376.731009:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683376.731027:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=310s v=(0 0) 00010000:00010000:3.0:1789683376.731032:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683376.731038:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683376.731057:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683376.731069:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683376.731078:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683376.731106:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683376.731340:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683376.731352:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683376.731367:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44430400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683376.731373:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683376.731386:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683376.731430:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683376.731437:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062aaf1fa/0x59bee33f93febc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683376.731462:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683376.731464:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683376.731466:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683376.736029:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d85180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815531008:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5086us (5219us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1789683376.736042:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1789683376.736918:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe48d84380/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789683376.736934:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815531008:0@lo:6:osp-syn-1-0.0 00000020:00000080:0.0:1789683377.034914:0:11661:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1dd5c900 20000000:00000080:0.0:1789683377.034936:0:11661:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dbe7d69e800 uarg=0000000000000000 20000000:01000000:0.0:1789683377.034980:0:11661:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789683377.034988:0:11661:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789683377.034994:0:11661:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1789683377.037585:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1789683377.038076:0:11661:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1789683377.044231:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1789683377.044321:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1789683377.044376:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1789683377.044394:0:11661:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789683377.044431:0:11661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044454:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea68 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044463:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea76 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044470:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93fea84 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044481:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff95 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044502:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff9c expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044510:0:11661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044557:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff9c expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044587:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff9c expref: 12 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683377.044605:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531136:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683377.044846:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff95 expref: 12 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044855:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff95 expref: 12 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683377.044864:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531264:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683377.044911:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fea84 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.044920:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fea84 expref: 18 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683377.044929:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531392:0@lo:104: 00000100:00100000:3.0:1789683377.050377:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683377.050619:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802912256 00000100:00100000:0.0:1789683377.050632:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802912256 00010000:00010000:0.0:1789683377.050699:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff9c expref: 13 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683377.051360:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:0.0:1789683377.051376:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802912256:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683377.051396:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683377.051405:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff9c expref: 13 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.051422:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff9c expref: 13 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.051476:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683377.051565:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802912256:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 194us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683377.051574:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1789683377.052549:0:11661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683377.052690:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fea76 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.052716:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fea76 expref: 18 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683377.052732:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531520:0@lo:104: 00000100:00100000:1.0:1789683377.052802:0:11661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683377.052829:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93fea68 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.052837:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93fea68 expref: 18 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683377.052845:0:11661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531648:0@lo:104: 00000100:00100000:1.0:1789683377.052869:0:11661:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683377.052919:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789683377.052933:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815531392 00000100:00100000:1.0:1789683377.052941:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815531392 00000100:00100000:1.0:1789683377.052989:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815531520 00000100:00100000:1.0:1789683377.052992:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815531520 00000100:00100000:1.0:1789683377.053003:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815531648 00000100:00100000:1.0:1789683377.053005:0:5812:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815531648 00000100:00100000:1.0:1789683377.053016:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789683377.053024:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+5:11661:x1876618815531392:12345-0@lo:104: 00010000:00010000:1.0:1789683377.053038:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053087:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683377.053092:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+5:11661:x1876618815531392:12345-0@lo:104: Request processed in 69us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683377.053105:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789683377.053121:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789683377.053126:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+4:11661:x1876618815531520:12345-0@lo:104: 00010000:00010000:1.0:1789683377.053133:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053164:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789683377.053169:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+4:11661:x1876618815531520:12345-0@lo:104: Request processed in 43us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683377.053174:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789683377.053185:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789683377.053190:0:5812:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbd44749c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+3:11661:x1876618815531648:12345-0@lo:104: 00010000:00010000:1.0:1789683377.053197:0:5812:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053237:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789683377.053242:0:5812:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbd44749c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:08ddc492-5684-492d-ac6b-b8fd660301db+3:11661:x1876618815531648:12345-0@lo:104: Request processed in 53us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683377.053258:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789683377.053301:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789683377.053309:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053317:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ea00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:1.0:1789683377.053322:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053344:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683377.053353:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683377.053359:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683377.053393:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053399:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683377.053418:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053425:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ea00/0x59bee33f93fea84 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea8b expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053440:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683377.053443:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053448:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e000 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:1.0:1789683377.053451:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053459:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683377.053465:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683377.053476:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683377.053490:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053496:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683377.053512:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053519:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e000/0x59bee33f93fea76 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea7d expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053527:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683377.053530:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053535:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d000 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:1.0:1789683377.053538:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053544:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683377.053550:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683377.053556:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789683377.053566:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053573:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683377.053584:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053591:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d000/0x59bee33f93fea68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93fea6f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.053604:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683377.053606:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683377.053607:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683377.053621:0:11661:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e93b600 going to sleep for 11 seconds 00010000:00010000:1.0:1789683377.053649:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93fea99 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff9c expref: 12 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683377.053659:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531136:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683377.053668:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531392:0@lo:104: 00000100:00100000:1.0:1789683377.053711:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fcb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531520:0@lo:104: 00000100:00100000:1.0:1789683377.053717:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531648:0@lo:104: 00000100:00100000:2.0:1789683377.054142:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815531776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683377.054193:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789683377.055178:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683377.055187:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683377.056168:0:11661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c433100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1876618815531264:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683377.056378:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:1.0:1789683377.056401:0:11661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683377.058531:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815531776 00000100:00100000:3.0:1789683377.058548:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815531776 00010000:00010000:3.0:1789683377.058612:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea84 expref: 19 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683377.058669:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683377.058691:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815531776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683377.058770:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683377.058778:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea84 expref: 19 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683377.058790:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fea84 expref: 19 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683377.058812:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8c800/0x59bee33f93fea8b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fea84 expref: 19 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683377.058831:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683377.058921:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+18:3303:x1876618815531776:12345-0@lo:103:ldlm_bl.0 Request processed in 230us (4727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683377.058929:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683377.058983:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815532032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683377.059040:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683377.059446:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815531904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789683377.059482:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683377.059849:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815531776:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683377.060298:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815532032 00000100:00100000:3.0:1789683377.060306:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815532032 00000100:00100000:1.0:1789683377.060309:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802912384 00000100:00100000:1.0:1789683377.060313:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802912384 00010000:00010000:3.0:1789683377.060336:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea68 expref: 18 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.060338:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff95 expref: 12 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683377.060355:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815531904 00000100:00100000:3.0:1789683377.060358:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815531904 00000100:00100000:1.0:1789683377.060365:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1789683377.060368:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea76 expref: 19 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683377.060371:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815532032:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683377.060380:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00010000:00010000:1.0:1789683377.060385:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789683377.060386:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85ca73fa-7ddf-4820-b817-0961de675c61+12:2352:x1876618802912384:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683377.060390:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea68 expref: 19 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683377.060394:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683377.060397:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff95 expref: 12 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.060400:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fea68 expref: 19 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683377.060433:0:7627:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789683377.060456:0:7627:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:0.0:1789683377.060510:0:5814:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789683377.060520:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789683377.060528:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815531904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683377.060537:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683377.060543:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93fea76 expref: 19 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683377.060634:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff95 expref: 12 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683377.060651:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e2200/0x59bee33f93fea92 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff95 expref: 12 pid: 5823 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683377.060663:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683377.060814:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496c6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:85ca73fa-7ddf-4820-b817-0961de675c61+11:2352:x1876618802912384:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 426us (4435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683377.060822:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00010000:00010000:1.0:1789683377.061947:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9400/0x59bee33f93fea6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fea68 expref: 19 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.062027:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683377.062097:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+18:3305:x1876618815532032:12345-0@lo:103:ldlm_bl.0 Request processed in 1725us (3056us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683377.062107:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1789683377.062124:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93fea76 expref: 17 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062137:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93fea7d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93fea76 expref: 17 pid: 5821 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062148:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062158:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062183:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062192:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683377.062314:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815532032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683377.062369:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062378:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062388:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3c00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683377.062393:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062402:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062423:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683377.062437:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683377.062464:0:11661:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.062473:0:11661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683377.062479:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febcd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683377.062600:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:08ddc492-5684-492d-ac6b-b8fd660301db+16:3304:x1876618815531904:12345-0@lo:103:ldlm_bl.0 Request processed in 2072us (3116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683377.062608:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789683377.062655:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815531904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683377.695903:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789683378.143798:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789683378.143807:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe53b2b800 from 7 10000000:01000000:3.0:1789683378.143812:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683378.143862:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683378.143875:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683378.143885:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683378.143911:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.143985:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683378.144045:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7bf34180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683378.144058:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815532160 00000100:00100000:0.0:1789683378.144067:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815532160 00000100:00100000:0.0:1789683378.144118:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789683378.144127:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe49751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+16:5825:x1876618815532160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683378.144141:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683378.144155:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40fe00/0x59bee33f93febdb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93febd4 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683378.144177:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40fe00/0x59bee33f93febdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93febd4 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683378.144203:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40fe00/0x59bee33f93febdb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93febd4 expref: 17 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683378.144211:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40fe00, rc 0) 00000100:00100000:0.0:1789683378.144265:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe49751050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815532160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683378.144273:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1789683378.144361:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683378.144375:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683378.144384:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683378.144433:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.144457:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683378.144472:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7bf34180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683378.144520:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815532288 00000100:00100000:2.0:1789683378.144525:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815532288 00000100:00100000:2.0:1789683378.144555:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789683378.144562:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815532288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683378.144834:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815532288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 271us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683378.144841:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1789683378.144941:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.144968:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.145012:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683378.145037:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7bf34180 going to sleep for 11 seconds 00000100:00100000:1.0:1789683378.145091:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815532416 00000100:00100000:1.0:1789683378.145096:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815532416 00000100:00100000:1.0:1789683378.145114:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789683378.145128:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815532416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683378.145274:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815532416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683378.145281:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789683378.145358:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683378.146863:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11675:1876618815532544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683378.146934:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683378.146980:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683378.147040:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815532544 00000100:00100000:1.0:1789683378.147047:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815532544 00000100:00100000:1.0:1789683378.147087:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789683378.147096:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:11675:x1876618815532544:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683378.148979:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:11675:x1876618815532544:12345-0@lo:502:llog_process_th.0 Request processed in 1876us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683378.148991:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789683378.149132:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11675:1876618815532544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683378.149177:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789683378.149186:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683378.149189:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789683378.149196:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dbe53b2b800 00000020:00000080:2.0:1789683378.149199:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789683378.149303:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11675:1876618815532672:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683378.149350:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683378.150290:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683378.150893:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815532672 00000100:00100000:3.0:1789683378.150901:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815532672 00000100:00100000:3.0:1789683378.150949:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789683378.150958:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:11675:x1876618815532672:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683378.151176:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+17:11675:x1876618815532672:12345-0@lo:502:llog_process_th.0 Request processed in 219us (1826us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.151184:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789683378.152320:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11675:1876618815532672:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789683378.152356:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789683378.152593:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789683378.152596:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789683378.152603:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789683378.152800:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789683378.152818:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683378.152829:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683378.152839:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683378.152850:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789683378.152852:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe52f3c000 from 7 10000000:01000000:3.0:1789683378.152855:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683378.152886:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683378.152894:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683378.152903:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683378.152933:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.152984:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683378.153016:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7bf34f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683378.153084:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815532800 00000100:00100000:1.0:1789683378.153090:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815532800 00000100:00100000:1.0:1789683378.153122:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789683378.153202:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+17:5825:x1876618815532800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683378.153214:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683378.153225:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febe9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93febe2 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683378.153254:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93febe2 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683378.153265:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febe9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93febe2 expref: 18 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683378.153273:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e3c00, rc 0) 00000100:00100000:1.0:1789683378.153318:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815532800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683378.153331:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1789683378.153752:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d85f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683378.153767:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683378.153775:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683378.153823:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683378.153850:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683378.153872:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683378.153916:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815532928 00000100:00100000:3.0:1789683378.153920:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815532928 00000100:00100000:3.0:1789683378.153950:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789683378.153956:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815532928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.154489:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815532928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 531us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.154496:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789683378.154888:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815532928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683378.154924:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815533056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789683378.154961:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683378.154982:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683378.155030:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815533056 00000100:00100000:3.0:1789683378.155035:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815533056 00000100:00100000:3.0:1789683378.155062:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789683378.155069:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815533056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.155546:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815533056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 476us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.155553:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1789683378.156046:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815533056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.156727:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d85500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11677:1876618815533184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683378.156777:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683378.156805:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7c11e240 going to sleep for 11 seconds 00000100:00100000:2.0:1789683378.156894:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815533184 00000100:00100000:2.0:1789683378.156899:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815533184 00000100:00100000:2.0:1789683378.156936:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789683378.156944:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:11677:x1876618815533184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683378.157105:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+18:11677:x1876618815533184:12345-0@lo:502:llog_process_th.0 Request processed in 162us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683378.157112:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789683378.157273:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d85500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11677:1876618815533184:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683378.157298:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683378.157307:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683378.157309:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683378.157318:0:11677:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dbe52f3c000 00000020:00000080:0.0:1789683378.157321:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789683378.157402:0:11677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11677:1876618815533312:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683378.157435:0:11677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683378.157458:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815533312 00000100:00100000:0.0:1789683378.157462:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815533312 00000100:00100000:0.0:1789683378.157483:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789683378.157489:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:11677:x1876618815533312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683378.157594:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:11677:x1876618815533312:12345-0@lo:502:llog_process_th.0 Request processed in 104us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683378.157600:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789683378.157632:0:11677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e83240 going to sleep for 11 seconds 00000100:00100000:0.0:1789683378.157643:0:11677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11677:1876618815533312:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683378.157660:0:11677:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683378.157668:0:11677:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683378.157669:0:11677:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789683378.157696:0:11677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789683378.160601:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789683378.160660:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683378.160693:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683378.160707:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683378.160718:0:5825:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683378.160721:0:5825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe46fc8800 from 7 10000000:01000000:2.0:1789683378.160723:0:5825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683378.160757:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683378.160765:0:5825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683378.160774:0:5825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683378.160797:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815533440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683378.160854:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683378.160891:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683378.161650:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815533440 00000100:00100000:0.0:1789683378.161658:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815533440 00000100:00100000:0.0:1789683378.161716:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789683378.161725:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+18:5825:x1876618815533440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683378.161739:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683378.161753:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40e000/0x59bee33f93febf7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93febf0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683378.161776:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40e000/0x59bee33f93febf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93febf0 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683378.161787:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40e000/0x59bee33f93febf7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93febf0 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683378.161795:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e000, rc 0) 00000100:00100000:0.0:1789683378.161844:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815533440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683378.161851:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789683378.162907:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815533440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683378.162928:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683378.162939:0:5825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683378.163006:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815533568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683378.163060:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683378.163161:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683378.171330:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815533568 00000100:00100000:3.0:1789683378.171345:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815533568 00000100:00100000:3.0:1789683378.171416:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789683378.171425:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815533568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.171746:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815533568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 322us (8685us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.171763:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1789683378.171820:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a19880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815533568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.171879:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815533696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.171921:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683378.171948:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe49228840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683378.171961:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815533696 00000100:00100000:3.0:1789683378.171965:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815533696 00000100:00100000:3.0:1789683378.171986:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789683378.171991:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815533696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.172123:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:5825:x1876618815533696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.172130:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1789683378.172165:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d84a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:08ddc492-5684-492d-ac6b-b8fd660301db:5825:1876618815533696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.172338:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11679:1876618815533824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683378.172371:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683378.172389:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815533824 00000100:00100000:3.0:1789683378.172392:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815533824 00000100:00100000:3.0:1789683378.172412:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789683378.172417:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:11679:x1876618815533824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683378.172527:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:11679:x1876618815533824:12345-0@lo:502:llog_process_th.0 Request processed in 110us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.172534:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1789683378.172559:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe492286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683378.172569:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11679:1876618815533824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683378.172592:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683378.172601:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683378.172603:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789683378.172610:0:11679:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dbe46fc8800 00000020:00000080:3.0:1789683378.172612:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789683378.172701:0:11679:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11679:1876618815533952:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683378.172733:0:11679:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683378.172751:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815533952 00000100:00100000:3.0:1789683378.172754:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815533952 00000100:00100000:3.0:1789683378.172773:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789683378.172779:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:11679:x1876618815533952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683378.172877:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:11679:x1876618815533952:12345-0@lo:502:llog_process_th.0 Request processed in 98us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.172883:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789683378.172907:0:11679:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe492286c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683378.172918:0:11679:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d84a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:08ddc492-5684-492d-ac6b-b8fd660301db:11679:1876618815533952:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683378.172934:0:11679:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683378.172938:0:11679:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683378.172939:0:11679:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789683378.172942:0:11679:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789683378.172984:0:5825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789683378.173004:0:5825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683378.173013:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683378.173024:0:5825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683378.197424:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683378.336979:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683378.337057:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802912512 00000100:00100000:0.0:1789683378.337068:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802912512 00000100:00100000:0.0:1789683378.337126:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 275 00000100:00100000:0.0:1789683378.337137:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+11:5588:x1876618802912512:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683378.337154:0:5822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683378.337172:0:5822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40ea00/0x59bee33f93febfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449effe9 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683378.337217:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40ea00/0x59bee33f93febfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effe9 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683378.337228:0:5822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40ea00/0x59bee33f93febfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effe9 expref: 12 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683378.337247:0:5822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ea00, rc 0) 00000100:00100000:0.0:1789683378.337308:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802912512:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 173us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683378.337315:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 275 00000100:00100000:3.0:1789683378.342801:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683378.344308:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802912640 00000100:00100000:1.0:1789683378.344323:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802912640 00000100:00100000:2.0:1789683378.344615:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 276 00000100:00100000:2.0:1789683378.344628:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802912640:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683378.345036:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48cd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802912640:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 409us (2242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683378.345046:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 276 00000100:00100000:1.0:1789683378.348076:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683378.348823:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802912768 00000100:00100000:3.0:1789683378.348842:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802912768 00000100:00100000:3.0:1789683378.348929:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 277 00000100:00100000:3.0:1789683378.348942:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802912768:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.349270:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802912768:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 329us (1202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.349538:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 277 00000100:00100000:3.0:1789683378.365912:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683378.372828:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802912896 00000100:00100000:2.0:1789683378.372848:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802912896 00000100:00100000:2.0:1789683378.373166:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 278 00000100:00100000:2.0:1789683378.373180:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+12:9950:x1876618802912896:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683378.373539:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+12:9950:x1876618802912896:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 361us (7640us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683378.373547:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 278 00000100:00100000:2.0:1789683378.386457:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683378.386585:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802913024 00000100:00100000:0.0:1789683378.386599:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802913024 00000100:00100000:0.0:1789683378.386663:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 279 00000100:00100000:0.0:1789683378.386705:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+12:9950:x1876618802913024:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683378.387038:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+12:9950:x1876618802913024:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 364us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683378.387047:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 279 00000100:00100000:1.0:1789683378.414303:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683378.417533:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802913152 00000100:00100000:2.0:1789683378.417556:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802913152 00000100:00100000:2.0:1789683378.417646:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 280 00000100:00100000:2.0:1789683378.417659:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+12:5588:x1876618802913152:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683378.417717:0:5821:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683378.417743:0:5821:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fec05 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449efff0 expref: -99 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683378.417787:0:5821:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fec05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efff0 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683378.417827:0:5821:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fec05 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efff0 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683378.417838:0:5821:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c400, rc 0) 00000100:00100000:2.0:1789683378.417931:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802913152:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 275us (3645us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683378.417939:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 280 00000100:00100000:1.0:1789683378.425090:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683378.425139:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802913280 00000100:00100000:3.0:1789683378.425152:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802913280 00000100:00100000:3.0:1789683378.425217:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 281 00000100:00100000:3.0:1789683378.425228:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802913280:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683378.425621:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802913280:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 392us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.425630:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 281 00000100:00100000:3.0:1789683378.428798:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683378.429561:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802913408 00000100:00100000:0.0:1789683378.429576:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802913408 00000100:00100000:0.0:1789683378.429653:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 282 00000100:00100000:0.0:1789683378.429665:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802913408:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683378.430523:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:5588:x1876618802913408:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 854us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683378.430534:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 282 00000100:00100000:1.0:1789683378.439439:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683378.439547:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802913536 00000100:00100000:0.0:1789683378.439580:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802913536 00000100:00100000:0.0:1789683378.439654:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 283 00000100:00100000:0.0:1789683378.439666:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:9953:x1876618802913536:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683378.440066:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:9953:x1876618802913536:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 400us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683378.440076:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 283 00000100:00100000:1.0:1789683378.444541:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683378.444652:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802913664 00000100:00100000:0.0:1789683378.444667:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802913664 00000100:00100000:0.0:1789683378.444951:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 284 00000100:00100000:0.0:1789683378.444965:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:9953:x1876618802913664:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683378.446477:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:9953:x1876618802913664:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 1505us (1939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683378.446492:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 284 00000100:00100000:2.0:1789683378.657900:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815534080:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683378.658005:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683378.658352:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815534080 00000100:00100000:3.0:1789683378.658365:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815534080 00000100:00100000:3.0:1789683378.658466:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789683378.658480:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815534080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683378.658538:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683378.658611:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815534080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683378.658637:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1789683378.658986:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683378.659184:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76fcb480 x1876618815534080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683378.659210:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815534080:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683378.720065:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789683379.233315:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683379.748050:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683380.385542:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683380.385739:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683380.385783:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683380.388566:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802914048 00000100:00100000:3.0:1789683380.388592:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802914048 00000100:00100000:3.0:1789683380.388756:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:3.0:1789683380.388774:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802914048:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683380.388889:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802914048:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 122us (3149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683380.388898:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00080000:3.0:1789683380.388927:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683380.389495:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683380.391135:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802913792 00000100:00100000:0.0:1789683380.391152:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802913792 00000100:00100000:0.0:1789683380.391428:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 285 00000100:00100000:0.0:1789683380.391442:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802913792:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683380.391545:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802913792:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 107us (6022us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683380.391553:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 285 00000100:00100000:1.0:1789683380.400696:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802913920 00000100:00100000:1.0:1789683380.400719:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802913920 00000100:00100000:3.0:1789683380.401871:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802914176 00000100:00100000:3.0:1789683380.401883:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802914176 00000100:00100000:2.0:1789683380.402505:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:2.0:1789683380.402525:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802914176:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683380.402925:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802914176:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 405us (13429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683380.402934:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00080000:3.0:1789683380.403331:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683380.406613:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:0.0:1789683380.406633:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802913920:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683380.406776:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802913920:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 150us (20991us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683380.406785:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:1.0:1789683380.704100:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815534464:0@lo:400:kworker.0 00000100:00100000:1.0:1789683380.704200:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683380.704240:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815534592:0@lo:400:kworker.0 00000100:00100000:1.0:1789683380.704311:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789683380.704318:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683380.704323:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815534336:0@lo:400:kworker.0 00000100:00100000:2.0:1789683380.704351:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789683380.704358:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683380.704361:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815534208:0@lo:400:kworker.0 00000100:00100000:1.0:1789683380.704386:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815534848:0@lo:400:kworker.0 00000100:00100000:2.0:1789683380.704403:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683380.704421:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683380.704433:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815534720:0@lo:400:kworker.0 00000100:00100000:2.0:1789683380.704460:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683380.704462:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815534464 00000100:00100000:1.0:1789683380.704471:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815534464 00000100:00100000:2.0:1789683380.704495:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815534336 00000100:00100000:2.0:1789683380.704501:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815534336 00000100:00100000:0.0:1789683380.704657:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815534592 00000100:00100000:0.0:1789683380.704664:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815534592 00000100:00100000:2.0:1789683380.704673:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815534720 00000100:00100000:2.0:1789683380.704700:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815534720 00000100:00100000:0.0:1789683380.704720:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815534848 00000100:00100000:0.0:1789683380.704725:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815534848 00000100:00100000:0.0:1789683380.704755:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789683380.704765:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815534592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683380.704783:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789683380.704793:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815534464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683380.704844:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815534592:12345-0@lo:400:kworker.0 Request processed in 80us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683380.704853:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789683380.704858:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815534464:12345-0@lo:400:kworker.0 Request processed in 66us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683380.704867:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789683380.704875:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789683380.704884:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815534848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683380.704889:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789683380.704898:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815534336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683380.704919:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815534848:12345-0@lo:400:kworker.0 Request processed in 37us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683380.704927:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789683380.704941:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815534336:12345-0@lo:400:kworker.0 Request processed in 44us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683380.704948:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789683380.704967:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1789683380.704974:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815534720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683380.704980:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683380.704992:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815534976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683380.705006:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876618815534720:12345-0@lo:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683380.705012:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789683380.705030:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683380.705075:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815534976 00000100:00100000:0.0:1789683380.705079:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815534976 00000100:00100000:2.0:1789683380.705091:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815534720:0@lo:400:kworker.0 00000100:00100000:0.0:1789683380.705108:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789683380.705117:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815534976:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1789683380.705124:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76fc9f80 x1876618815534592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683396 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683380.705137:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815534592:0@lo:400:kworker.0 00002000:00000024:0.0:1789683380.705152:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683380.705168:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815534208 00000100:00100000:2.0:1789683380.705173:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815534208 00000100:00100000:0.0:1789683380.705198:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815534976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683380.705203:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1789683380.705213:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815534208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683380.705353:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815534336:0@lo:400:kworker.0 00000100:00100000:1.0:1789683380.705365:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815534848:0@lo:400:kworker.0 00000100:00100000:1.0:1789683380.705375:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815534464:0@lo:400:kworker.0 00000100:00080000:1.0:1789683380.705396:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683380.705408:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683380.705411:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683380.705443:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815534976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683380.705713:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815534208:12345-0@lo:400:kworker.0 Request processed in 499us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683380.705729:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815534208:0@lo:400:kworker.0 00000100:00100000:2.0:1789683380.705938:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789683380.705964:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00010000:1.0:1789683380.772600:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789683381.789886:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1789683381.792119:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683382.818595:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683383.778322:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683383.778354:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815535104:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683383.778449:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683383.778603:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815535104 00000100:00100000:0.0:1789683383.778612:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815535104 00000100:00100000:0.0:1789683383.778729:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789683383.778745:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815535104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683383.778806:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683383.778868:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815535104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683383.778875:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:0.0:1789683383.778922:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76fc9180 x1876618815535104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683383.778944:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815535104:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789683383.779136:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789683383.840007:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683384.864127:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683385.505960:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683385.506021:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683385.506135:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802914304 00000100:00100000:0.0:1789683385.506159:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802914304 00000100:00100000:0.0:1789683385.506258:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 287 00000100:00100000:0.0:1789683385.506271:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802914304:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683385.506373:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802914304:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 104us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683385.506381:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 287 00000100:00100000:3.0:1789683385.511093:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802914432 00000100:00100000:3.0:1789683385.511115:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802914432 00000100:00100000:3.0:1789683385.511257:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:3.0:1789683385.511270:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802914432:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683385.511381:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802914432:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 114us (5359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683385.511390:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00080000:2.0:1789683385.512010:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683385.515199:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683385.515397:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683385.515496:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802914560 00000100:00100000:0.0:1789683385.515509:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802914560 00000100:00100000:0.0:1789683385.515596:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:0.0:1789683385.515611:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802914560:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683385.515756:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802914560:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 148us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683385.515764:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00080000:1.0:1789683385.516138:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683385.516655:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802914688 00000100:00100000:2.0:1789683385.516665:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802914688 00000100:00100000:2.0:1789683385.519215:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:2.0:1789683385.519250:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802914688:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683385.519369:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802914688:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 123us (4192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683385.519377:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00080000:1.0:1789683385.523506:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683385.824497:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815535232:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683385.824596:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683385.824712:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815535232 00000100:00100000:0.0:1789683385.824722:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815535232 00000100:00100000:0.0:1789683385.824804:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789683385.824812:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815535232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683385.824851:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683385.824890:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815535232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683385.824897:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789683385.824940:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1789683385.824947:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe48d84380, transno 4294967300 00000100:00100000:0.0:1789683385.826132:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815535232:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789683385.826251:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683385.827847:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815535616:0@lo:400:kworker.0 00000100:00100000:0.0:1789683385.828016:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683385.828063:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683385.828070:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815535744:0@lo:400:kworker.0 00000100:00100000:0.0:1789683385.828114:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683385.828170:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815535616 00000100:00100000:0.0:1789683385.828188:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815535616 00000100:00080000:1.0:1789683385.829714:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683385.830207:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1789683385.830227:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815535616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683385.830311:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815535488:0@lo:400:kworker.0 00000100:00100000:0.0:1789683385.830329:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815535616:12345-0@lo:400:kworker.0 Request processed in 111us (2314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683385.830336:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1789683385.830352:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683385.830387:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789683385.830395:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815535360:0@lo:400:kworker.0 00000100:00100000:1.0:1789683385.830425:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683385.830457:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815535872:0@lo:400:kworker.0 00000100:00100000:1.0:1789683385.830480:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683385.830854:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815535744 00000100:00100000:2.0:1789683385.830864:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815535744 00000100:00100000:2.0:1789683385.830916:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683385.830939:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815535744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683385.830991:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815535744:12345-0@lo:400:kworker.0 Request processed in 54us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683385.831137:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815535360 00000100:00100000:1.0:1789683385.831142:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815535360 00000100:00100000:1.0:1789683385.831285:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1789683385.831292:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815535360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683385.831331:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815535360:12345-0@lo:400:kworker.0 Request processed in 40us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683385.831338:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1789683385.832209:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1789683385.832894:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683385.834237:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815535488 00000100:00100000:0.0:1789683385.834255:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815535488 00000100:00100000:0.0:1789683385.834333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815535872 00010000:00080000:2.0:1789683385.834336:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c526a00 x1876618815535744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683401 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683385.834354:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815535872 00000100:00100000:2.0:1789683385.834356:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815535744:0@lo:400:kworker.0 00000100:00100000:2.0:1789683385.834374:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815535616:0@lo:400:kworker.0 00000100:00100000:0.0:1789683385.834407:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789683385.834419:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815535488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683385.834428:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789683385.834439:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815535872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683385.836137:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815535872:12345-0@lo:400:kworker.0 Request processed in 1692us (5646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683385.836150:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00080000:2.0:1789683385.836231:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683385.836319:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815535360:0@lo:400:kworker.0 00000100:00100000:2.0:1789683385.836337:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815535872:0@lo:400:kworker.0 00000100:00100000:0.0:1789683385.839466:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815535488:12345-0@lo:400:kworker.0 Request processed in 5036us (9098us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683385.839486:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789683385.839695:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b949f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815535488:0@lo:400:kworker.0 00010000:00010000:1.0:1789683385.889220:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683386.914564:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683387.935965:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683388.898616:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815536000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683388.898732:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683388.899039:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815536000 00000100:00100000:0.0:1789683388.899049:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815536000 00000100:00100000:0.0:1789683388.899136:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789683388.899149:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815536000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683388.899205:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683388.899272:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815536000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683388.899279:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1789683388.899538:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789683388.899590:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76fc8700 x1876618815536000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683388.899615:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815536000:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683388.960029:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683389.472791:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683389.986333:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683390.632457:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683390.632521:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683390.632663:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802914944 00000100:00100000:2.0:1789683390.632700:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802914944 00000100:00100000:2.0:1789683390.632795:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:2.0:1789683390.632808:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802914944:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683390.632907:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802914944:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 102us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683390.632915:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:0.0:1789683390.633351:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802914816 00000100:00100000:0.0:1789683390.633357:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802914816 00000100:00100000:0.0:1789683390.633402:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 289 00000100:00100000:0.0:1789683390.633411:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802914816:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683390.633452:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802914816:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 43us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683390.633459:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 289 00000100:00080000:3.0:1789683390.633747:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683390.658726:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683390.658771:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683390.658874:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802915200 00000100:00100000:2.0:1789683390.658888:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802915200 00000100:00100000:2.0:1789683390.658980:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:2.0:1789683390.658993:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802915200:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683390.659103:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802915200:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 112us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683390.659111:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:0.0:1789683390.659531:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802915072 00000100:00100000:0.0:1789683390.659536:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802915072 00000100:00100000:0.0:1789683390.659578:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:0.0:1789683390.659586:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2351:x1876618802915072:12345-192.168.203.60@tcp:9:kworker.0 00000020:00000080:0.0:1789683390.659612:0:6677:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93feb41 00000100:00080000:0.0:1789683390.659639:0:6677:0:(import.c:65:import_set_state_nolock()) ffff8dbe52f3c800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683390.659715:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1789683390.660001:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+2:2351:x1876618802915072:12345-192.168.203.60@tcp:9:kworker.0 Request processed in 415us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683390.660009:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:1.0:1789683390.660099:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683390.660642:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683390.660648:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683390.944577:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683390.944618:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815536128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683390.944728:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683390.945156:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815536128 00000100:00100000:0.0:1789683390.945167:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815536128 00000100:00100000:0.0:1789683390.945237:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789683390.945248:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815536128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683390.945298:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683390.945356:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815536128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683390.945363:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789683390.945366:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815536384:0@lo:400:kworker.0 00000100:00080000:0.0:1789683390.945392:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683390.945415:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683390.945420:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815536512:0@lo:400:kworker.0 00000100:00100000:0.0:1789683390.945446:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683390.945708:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815536384 00000100:00100000:2.0:1789683390.945713:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815536384 00000100:00100000:1.0:1789683390.945839:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815536256:0@lo:400:kworker.0 00000100:00100000:1.0:1789683390.945874:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683390.945899:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815536768:0@lo:400:kworker.0 00000100:00100000:1.0:1789683390.945918:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683390.945970:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815536640:0@lo:400:kworker.0 00000100:00100000:3.0:1789683390.946018:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683390.946069:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815536256 00000100:00100000:3.0:1789683390.946074:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815536256 00000100:00100000:3.0:1789683390.946104:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789683390.946111:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815536256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683390.946159:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815536256:12345-0@lo:400:kworker.0 Request processed in 49us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683390.946166:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:3.0:1789683390.946195:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815536640 00000100:00100000:3.0:1789683390.946198:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815536640 00000100:00100000:3.0:1789683390.946231:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789683390.946237:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815536640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683390.946274:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815536640:12345-0@lo:400:kworker.0 Request processed in 37us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683390.946280:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1789683390.946296:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789683390.946326:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe799c8000 x1876618815536640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683406 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683390.946342:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815536640:0@lo:400:kworker.0 00000100:00100000:1.0:1789683390.948927:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815536128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683390.948968:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815536256:0@lo:400:kworker.0 00000100:00100000:0.0:1789683390.953648:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815536512 00000100:00100000:2.0:1789683390.953666:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815536768 00000100:00100000:0.0:1789683390.953670:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815536512 00000100:00100000:2.0:1789683390.953691:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815536768 00000100:00100000:1.0:1789683390.953769:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789683390.953777:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1789683390.953861:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683390.953924:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789683390.953934:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815536768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683390.954770:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815536512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683390.954847:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815536384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683390.955298:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815536768:0@lo:400:kworker.0 00000100:00100000:2.0:1789683390.958774:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815536768:12345-0@lo:400:kworker.0 Request processed in 4828us (12840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683390.958791:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789683390.959008:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815536384:12345-0@lo:400:kworker.0 Request processed in 5225us (13589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683390.959016:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1789683390.959286:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815536384:0@lo:400:kworker.0 00000100:00100000:0.0:1789683390.959580:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815536512:12345-0@lo:400:kworker.0 Request processed in 5794us (14130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683390.959589:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789683390.959832:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815536512:0@lo:400:kworker.0 00010000:00010000:1.0:1789683391.008171:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789683392.027955:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:3.0:1789683392.027969:0:7641:0:(genops.c:885:class_export_put()) final put ffff8dbe7bfb9800/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:1.0:1789683392.028055:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7bfb9800/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 for lustre-OST0001 00000020:00000080:1.0:1789683392.028126:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe52f3c800 for lustre-OST0001 00010000:00010000:1.0:1789683392.031967:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683393.056043:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683394.016237:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683394.016268:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815536896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683394.016363:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683394.016757:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815536896 00000100:00100000:1.0:1789683394.016768:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815536896 00000100:00100000:1.0:1789683394.016841:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789683394.016853:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815536896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683394.016901:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789683394.016906:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683394.016970:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815536896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683394.016977:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:3.0:1789683394.017388:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76fca680 x1876618815536896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683394.017464:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815536896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683394.081040:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683395.104319:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683395.749355:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683395.749417:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683395.749454:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683395.749497:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802915456 00000100:00100000:3.0:1789683395.749509:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802915456 00000100:00100000:3.0:1789683395.749580:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802915584 00000100:00100000:3.0:1789683395.749584:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802915584 00000100:00100000:3.0:1789683395.749609:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:3.0:1789683395.749621:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802915456:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683395.750139:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:0.0:1789683395.750171:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802915584:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683395.750247:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802915584:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683395.750256:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:2.0:1789683395.750551:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802915328 00000100:00100000:2.0:1789683395.750557:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802915328 00000100:00080000:0.0:1789683395.755485:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683395.758241:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 291 00000100:00100000:2.0:1789683395.758278:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802915328:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683395.758411:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802915328:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 152us (8991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683395.758420:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 291 00000100:00100000:3.0:1789683395.758928:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802915456:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 9305us (9583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683395.758939:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:1.0:1789683396.064122:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815537408:0@lo:400:kworker.0 00000100:00100000:1.0:1789683396.064220:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683396.064298:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789683396.064305:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815537024:0@lo:400:kworker.0 00000100:00100000:1.0:1789683396.064338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683396.064361:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815537536:0@lo:400:kworker.0 00000100:00100000:1.0:1789683396.064388:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683396.064607:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815537408 00000100:00100000:0.0:1789683396.064618:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815537408 00000100:00100000:0.0:1789683396.064723:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789683396.064736:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815537408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683396.064812:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815537408:12345-0@lo:400:kworker.0 Request processed in 79us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683396.064820:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789683396.064848:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815537536 00000100:00100000:0.0:1789683396.064852:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815537536 00010000:00080000:2.0:1789683396.064977:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76fc8000 x1876618815537408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683412 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683396.064995:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815537408:0@lo:400:kworker.0 00000100:00100000:0.0:1789683396.065083:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1789683396.065090:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815537536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683396.065138:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815537536:12345-0@lo:400:kworker.0 Request processed in 48us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683396.065144:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789683396.065216:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815537536:0@lo:400:kworker.0 00000100:00080000:1.0:1789683396.065394:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683396.065400:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683396.065506:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815537152:0@lo:400:kworker.0 00000100:00100000:3.0:1789683396.065548:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683396.065577:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815537664:0@lo:400:kworker.0 00000100:00100000:3.0:1789683396.065598:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683396.065664:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789683396.065691:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815537280:0@lo:400:kworker.0 00000100:00100000:3.0:1789683396.065715:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683396.065731:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815537792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683396.065755:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683396.065789:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815537024 00000100:00100000:3.0:1789683396.065794:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815537024 00000100:00100000:3.0:1789683396.065823:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789683396.065847:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815537024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683396.065901:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53a7bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815537024:12345-0@lo:400:kworker.0 Request processed in 55us (1561us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683396.065908:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1789683396.065938:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815537792 00000100:00100000:3.0:1789683396.065942:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815537792 00000100:00100000:3.0:1789683396.065969:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789683396.065976:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815537792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683396.066009:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683396.066045:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815537792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683396.066050:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789683396.066084:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815537792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683396.066142:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815537024:0@lo:400:kworker.0 00000100:00100000:1.0:1789683396.066385:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815537152 00000100:00100000:1.0:1789683396.066390:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815537152 00000100:00100000:1.0:1789683396.066427:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815537280 00000100:00100000:1.0:1789683396.066430:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815537280 00000100:00100000:1.0:1789683396.066452:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789683396.066460:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815537152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683396.066509:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815537152:12345-0@lo:400:kworker.0 Request processed in 50us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683396.066514:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789683396.066526:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789683396.066531:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815537280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683396.066555:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815537280:12345-0@lo:400:kworker.0 Request processed in 23us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683396.066559:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:1.0:1789683396.066571:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683396.066574:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683396.066589:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815537280:0@lo:400:kworker.0 00000100:00100000:1.0:1789683396.066599:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815537152:0@lo:400:kworker.0 00000100:00100000:2.0:1789683396.068637:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815537664 00000100:00100000:2.0:1789683396.068656:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815537664 00000100:00100000:2.0:1789683396.068778:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789683396.068790:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815537664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683396.068907:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815537664:12345-0@lo:400:kworker.0 Request processed in 120us (3307us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683396.068915:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683396.069000:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815537664:0@lo:400:kworker.0 00010000:00010000:1.0:1789683396.128135:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683397.152825:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683398.175883:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683399.135941:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815537920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683399.136014:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683399.136173:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815537920 00000100:00100000:3.0:1789683399.136180:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815537920 00000100:00100000:3.0:1789683399.136243:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789683399.136253:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815537920:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789683399.136262:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789683399.136290:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683399.136342:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d85f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815537920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683399.136349:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:2.0:1789683399.136431:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe48d85500 x1876618815537920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683399.136450:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48d85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815537920:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683399.205773:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789683399.721430:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683400.224342:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683400.869144:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683400.869188:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683400.869218:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683400.869257:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802915968 00000100:00100000:0.0:1789683400.869267:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802915968 00000100:00100000:0.0:1789683400.869330:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802915840 00000100:00100000:0.0:1789683400.869333:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802915840 00000100:00100000:0.0:1789683400.869356:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:0.0:1789683400.869365:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802915968:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683400.869453:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802915968:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 88us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683400.869461:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:0.0:1789683400.869479:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:0.0:1789683400.869497:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802915840:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683400.869524:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802915840:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683400.869530:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00080000:0.0:1789683400.869547:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683400.873861:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802915712 00000100:00100000:2.0:1789683400.873875:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802915712 00000100:00100000:2.0:1789683400.873926:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 293 00000100:00100000:2.0:1789683400.873935:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802915712:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683400.874004:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802915712:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 70us (4870us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683400.874011:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 293 00000100:00100000:1.0:1789683401.184058:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815538432:0@lo:400:kworker.0 00000100:00100000:1.0:1789683401.184138:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683401.184270:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789683401.184277:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815538048:0@lo:400:kworker.0 00000100:00100000:1.0:1789683401.184302:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683401.184318:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815538560:0@lo:400:kworker.0 00000100:00100000:1.0:1789683401.184338:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683401.184374:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815538176:0@lo:400:kworker.0 00000100:00100000:3.0:1789683401.184611:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815538304:0@lo:400:kworker.0 00000100:00100000:0.0:1789683401.184714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815538560 00000100:00100000:0.0:1789683401.184722:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815538560 00000100:00100000:0.0:1789683401.184768:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789683401.184776:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815538560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683401.185000:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815538432 00000100:00100000:2.0:1789683401.185005:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815538432 00000100:00100000:2.0:1789683401.185036:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683401.185043:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815538432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683401.186180:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683401.186239:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815538048 00000100:00100000:3.0:1789683401.186245:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815538048 00000100:00100000:3.0:1789683401.186293:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789683401.186302:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815538048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683401.186348:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815538048:12345-0@lo:400:kworker.0 Request processed in 47us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683401.186355:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1789683401.186420:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815538304 00000100:00100000:3.0:1789683401.186424:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815538304 00000100:00100000:3.0:1789683401.186452:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789683401.186458:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815538304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683401.186489:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815538304:12345-0@lo:400:kworker.0 Request processed in 31us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683401.186495:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789683401.186827:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815538816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683401.187141:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683401.187184:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c527b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815538304:0@lo:400:kworker.0 00000100:00100000:3.0:1789683401.187212:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815538816 00000100:00100000:3.0:1789683401.187216:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815538816 00000100:00100000:3.0:1789683401.187245:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683401.187252:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7628ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815538816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789683401.187278:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683401.187315:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7628ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815538816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683401.187321:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789683401.187700:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815538048:0@lo:400:kworker.0 00000100:00100000:3.0:1789683401.187732:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815538816:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683401.188024:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815538560:12345-0@lo:400:kworker.0 Request processed in 3246us (3682us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683401.188034:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:0.0:1789683401.188059:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683401.188075:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683401.188078:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683401.188183:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815538560:0@lo:400:kworker.0 00000100:00100000:1.0:1789683401.188294:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683401.188364:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815538688:0@lo:400:kworker.0 00000100:00100000:1.0:1789683401.188394:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683401.188629:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815538176 00000100:00100000:3.0:1789683401.188635:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815538176 00000100:00100000:3.0:1789683401.188727:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789683401.188735:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815538176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683401.188836:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815538176:12345-0@lo:400:kworker.0 Request processed in 103us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683401.188843:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789683401.189179:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815538688 00000100:00100000:0.0:1789683401.189184:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815538688 00000100:00100000:0.0:1789683401.189224:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789683401.189231:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815538688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683401.189268:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815538688:12345-0@lo:400:kworker.0 Request processed in 37us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683401.189274:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789683401.189376:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c527800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815538176:0@lo:400:kworker.0 00000100:00100000:1.0:1789683401.189386:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815538688:0@lo:400:kworker.0 00000100:00100000:2.0:1789683401.189644:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815538432:12345-0@lo:400:kworker.0 Request processed in 4600us (5503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683401.189651:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:3.0:1789683401.190052:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe7c524a80 x1876618815538432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789683417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683401.190078:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815538432:0@lo:400:kworker.0 00010000:00010000:0.0:1789683401.253612:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683401.437007:0:11850:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:16:40 (1789683400) 00010000:00010000:1.0:1789683402.271954:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683403.295979:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683403.327877:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683403.328031:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802916096 00000100:00100000:3.0:1789683403.328045:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802916096 00000100:00100000:3.0:1789683403.328152:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:3.0:1789683403.328165:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:10223:x1876618802916096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683403.328195:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683403.328223:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93fec0c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449efff7 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789683403.328484:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789683403.329255:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430a00/0x59bee33f93fec13 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.329279:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430a00/0x59bee33f93fec13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.329722:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430a00/0x59bee33f93fec13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683403.329767:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789683403.329772:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683403.329814:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430a00/0x59bee33f93fec13 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.329848:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93fec0c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efff7 expref: 7 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.329870:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430a00/0x59bee33f93fec13 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efff7 expref: 6 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.329879:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:3.0:1789683403.329882:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683403.329886:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe44430a00, rc 0) 00000100:00100000:3.0:1789683403.330310:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:10223:x1876618802916096:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2135us (2437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683403.330322:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:3.0:1789683403.362928:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683403.367410:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802916224 00000100:00100000:0.0:1789683403.367425:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802916224 00000100:00100000:0.0:1789683403.367573:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1789683403.367585:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:10224:x1876618802916224:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683403.367606:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683403.367627:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fec1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449efffe expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.367807:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.367822:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.367833:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.367912:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.367987:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.367995:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368384:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f600/0x59bee33f93fec2f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368393:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f600/0x59bee33f93fec2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368410:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f600/0x59bee33f93fec2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683403.368442:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789683403.368446:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683403.368781:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f600/0x59bee33f93fec2f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368794:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368801:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368809:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368815:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fc00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683403.368819:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368827:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368915:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:0.0:1789683403.368987:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683403.368994:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.368999:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fec21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369023:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369029:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369034:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369039:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683403.369042:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369057:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369066:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8dbe60aa2700) 00010000:00010000:0.0:1789683403.369069:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683403.369073:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369079:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fec28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369115:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fec1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efffe expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369130:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f600/0x59bee33f93fec2f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efffe expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.369149:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dbe60aa2100) 00010000:00010000:0.0:1789683403.369152:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683403.369155:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f600, rc 0) 00000100:00100000:0.0:1789683403.369294:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:10224:x1876618802916224:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1710us (6374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683403.369302:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1789683403.384409:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683403.384496:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802916480 00000100:00100000:3.0:1789683403.384507:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802916480 00000100:00100000:3.0:1789683403.384568:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1789683403.384579:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:10224:x1876618802916480:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683403.384603:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683403.384631:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93fec36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0005 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.384776:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.384791:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.384804:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.384819:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.384826:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.384832:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385322:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9400/0x59bee33f93fec4b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385331:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9400/0x59bee33f93fec4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385337:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9400/0x59bee33f93fec4b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683403.385346:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1789683403.385482:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385490:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385504:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385509:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44431600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683403.385513:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385521:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385534:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dbe60aa2100) 00010000:00010000:3.0:1789683403.385537:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683403.385542:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385548:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44431600/0x59bee33f93fec3d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385563:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385569:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385574:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385579:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44430600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683403.385582:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385597:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385606:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dbe5931ed00) 00010000:00010000:3.0:1789683403.385608:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683403.385611:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683403.385617:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430600/0x59bee33f93fec44 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.387848:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430400/0x59bee33f93fec36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0005 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.387894:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9400/0x59bee33f93fec4b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0005 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683403.387905:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:0.0:1789683403.387908:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683403.387912:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9400, rc 0) 00000100:00100000:0.0:1789683403.387990:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:10224:x1876618802916480:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3412us (3590us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789683403.387999:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1789683403.397445:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683403.397854:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802916608 00000100:00100000:3.0:1789683403.397873:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802916608 00000100:00100000:3.0:1789683403.397935:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:3.0:1789683403.397946:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:10224:x1876618802916608:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1789683403.398080:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:10224:x1876618802916608:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 135us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683403.398087:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000040:00080000:0.0:1789683403.808361:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789683404.258844:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683404.258866:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815538944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683404.258942:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683404.259103:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815538944 00000100:00100000:3.0:1789683404.259112:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815538944 00000100:00100000:3.0:1789683404.259173:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1789683404.259182:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815538944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683404.259216:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683404.259263:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815538944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683404.259270:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1789683404.259307:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe760c5f80 x1876618815538944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683404.259333:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760c5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815538944:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789683404.260298:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683404.319959:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683405.360278:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683405.998123:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683405.998278:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683405.998357:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683405.998421:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683405.998436:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802916864 00000100:00100000:1.0:1789683405.998445:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802916864 00000100:00100000:1.0:1789683405.998507:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802916992 00000100:00100000:1.0:1789683405.998511:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802916992 00000100:00100000:1.0:1789683405.998535:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:1.0:1789683405.998544:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2353:x1876618802916992:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683405.998630:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2353:x1876618802916992:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 87us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683405.998637:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:1.0:1789683405.998655:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1789683405.998662:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:10266:x1876618802916864:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683405.998702:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683405.998722:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2200/0x59bee33f93fec59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f000c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.998876:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.998907:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.998920:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.998937:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.998944:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.998951:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999139:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999148:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999154:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999160:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683405.999838:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999851:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999865:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:1.0:1789683405.999876:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683405.999882:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999888:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fec60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999903:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999909:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999916:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999921:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683405.999924:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999929:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999937:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8dbe46df9e00) 00010000:00010000:1.0:1789683405.999939:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683405.999942:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999946:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fec67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683405.999982:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2200/0x59bee33f93fec59 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f000c expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.000002:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:1.0:1789683406.000005:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683406.000009:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2200/0x59bee33f93fec59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f000c expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.000018:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e2200, rc 0) 00000100:00100000:1.0:1789683406.000069:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:10266:x1876618802916864:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1407us (1791us total) trans 0 rc 301/301 00000100:00100000:1.0:1789683406.000077:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00080000:1.0:1789683406.000108:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683406.000577:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802916736 00000100:00100000:3.0:1789683406.000585:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802916736 00000100:00100000:3.0:1789683406.000920:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 295 00000100:00100000:3.0:1789683406.000933:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802916736:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683406.000981:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802916736:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 52us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683406.000987:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 295 00000100:00100000:3.0:1789683406.001017:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802917120 00000100:00100000:3.0:1789683406.001022:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802917120 00000100:00100000:3.0:1789683406.001337:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00100000:3.0:1789683406.001345:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802917120:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683406.001378:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802917120:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 34us (2957us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683406.001384:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00080000:1.0:1789683406.001561:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683406.021145:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683406.021906:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802917376 00000100:00100000:3.0:1789683406.021917:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802917376 00000100:00100000:3.0:1789683406.021972:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:3.0:1789683406.021982:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:10266:x1876618802917376:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:3.0:1789683406.022049:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683406.022089:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe44430a00/0x59bee33f93fec13 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efff7 expref: 9 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.022110:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:3.0:1789683406.022122:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683406.022345:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.022359:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.022369:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.022381:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.022388:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.022394:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683406.025907:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789683406.025927:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.025938:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.025947:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.025969:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683406.025974:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.025981:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.025997:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931ed00) 00010000:00010000:3.0:1789683406.026000:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683406.026006:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.026012:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683406.026044:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000051a152cb reply state 00000000902ce0f7 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683406.026053:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683406.026738:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:10266:x1876618802917376:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 4752us (5595us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789683406.026916:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00010000:00010000:3.0:1789683406.038307:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.038325:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.038333:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.038353:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683406.038358:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.038365:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.038382:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8dbe5931e900) 00010000:00010000:3.0:1789683406.038385:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683406.038391:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.038397:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec75 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683406.140540:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683406.140822:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802917504 00000100:00100000:3.0:1789683406.140841:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802917504 00000100:00100000:3.0:1789683406.140923:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1789683406.140937:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:10274:x1876618802917504:12345-192.168.203.60@tcp:101:lctl.0 00010000:00010000:3.0:1789683406.140975:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683406.141139:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0013 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.141237:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.141256:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.141273:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683406.141341:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789683406.141346:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683406.141395:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.141425:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fec7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0013 expref: 11 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.141449:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0013 expref: 10 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.141459:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931e900) 00010000:00010000:3.0:1789683406.141462:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683406.141467:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9c00, rc 0) 00000100:00100000:3.0:1789683406.141556:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:10274:x1876618802917504:12345-192.168.203.60@tcp:101:lctl.0 Request processed in 622us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683406.141564:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:1.0:1789683406.206885:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683406.208416:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802917632 00000100:00100000:0.0:1789683406.208434:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802917632 00000100:00100000:0.0:1789683406.208532:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:0.0:1789683406.208545:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:10280:x1876618802917632:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683406.208573:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683406.208621:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93fec8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f001a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.208767:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.208786:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.208802:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.208820:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.208828:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.208835:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.208963:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93fec9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.208973:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93fec9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.208981:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93fec9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683406.209152:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789683406.209156:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683406.209282:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93fec9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209307:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209314:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209322:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209328:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fa00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683406.209333:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209341:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209355:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931e900) 00010000:00010000:0.0:1789683406.209358:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683406.209365:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209372:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fec91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209389:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209396:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209403:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209415:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683406.209417:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209423:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209431:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8dbe60aa2700) 00010000:00010000:0.0:1789683406.209434:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683406.209437:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209443:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fec98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209486:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93fec8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f001a expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209501:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93fec9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f001a expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.209509:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683406.209511:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789683406.209513:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e400, rc 0) 00000100:00100000:0.0:1789683406.209607:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:10280:x1876618802917632:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1063us (2731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683406.209616:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:0.0:1789683406.215907:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683406.216220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802917888 00000100:00100000:3.0:1789683406.216235:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802917888 00000100:00100000:3.0:1789683406.216315:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1789683406.216328:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:10280:x1876618802917888:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683406.216356:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683406.216383:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93feca6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0021 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.216766:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.216799:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.216813:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.217164:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.217188:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.217202:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683406.217849:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1789683406.218051:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218063:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218072:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218111:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218119:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218126:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218139:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683406.218143:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218151:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218164:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:3.0:1789683406.218168:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683406.218173:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218179:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683406.218192:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c58ba278 reply state 000000004320a3a9 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683406.218201:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789683406.218237:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93feca6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0021 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218252:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0021 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.218259:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:3.0:1789683406.218261:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683406.218263:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8400, rc 0) 00000100:00100000:3.0:1789683406.218798:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10280:x1876618802917888:12345-192.168.203.60@tcp:101:bash.0 Request processed in 2012us (2446us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789683406.218815:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00010000:00010000:1.0:1789683406.226180:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.226196:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.226204:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.226210:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683406.226215:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.226235:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.226267:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe5931ed00) 00010000:00010000:1.0:1789683406.226270:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683406.226275:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.226282:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fecb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683406.226717:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683406.226839:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802918016 00000100:00100000:3.0:1789683406.226849:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802918016 00000100:00100000:3.0:1789683406.226893:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1789683406.226902:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876618802918016:12345-192.168.203.60@tcp:8:bash.0 00010000:00080000:3.0:1789683406.226943:0:6674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:3.0:1789683406.226978:0:6674:0:(genops.c:1384:class_connect()) connect: client 54d6ac2c-8152-4eed-adb8-5b5d9e80a202, cookie 0x59bee33f93fecc9 00002000:00100000:3.0:1789683406.226991:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 54d6ac2c-8152-4eed-adb8-5b5d9e80a202/ffff8dbe75e5c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789683406.227073:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789683406.227564:0:6674:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789683406.227598:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8dbe75e5a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683406.227712:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2351:x1876618802918016:12345-192.168.203.60@tcp:8:bash.0 Request processed in 769us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683406.227722:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:1.0:1789683406.236768:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683406.236881:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802918144 00000100:00100000:2.0:1789683406.236891:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802918144 00000100:00100000:2.0:1789683406.237210:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:2.0:1789683406.237224:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:0:x1876618802918144:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1789683406.237260:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683406.237284:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0028 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683406.237312:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683406.237332:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=339s v=(0 0) 00010000:00010000:2.0:1789683406.237336:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683406.237346:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0028 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.237367:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0028 expref: 7 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.237381:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8da00, rc 0) 00000100:00100000:2.0:1789683406.237446:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:0:x1876618802918144:12345-192.168.203.60@tcp:101:bash.0 Request processed in 225us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683406.237453:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00080000:1.0:1789683406.237792:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683406.241239:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683406.241342:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802918272 00000100:00100000:3.0:1789683406.241353:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802918272 00000100:00100000:3.0:1789683406.241414:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1789683406.241424:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:10280:x1876618802918272:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683406.241443:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683406.241464:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f002f expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.241497:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0028 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.241523:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683406.241527:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683406.241532:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.241901:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0028 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.241917:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0028 expref: 8 pid: 6676 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683406.249462:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6674:1876618815539072:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683406.249760:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53d55180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683406.253208:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6674:1876618815539072:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683406.253246:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.253266:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8200, rc 0) 00000100:00100000:2.0:1789683406.253334:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:10280:x1876618802918272:12345-192.168.203.60@tcp:101:bash.0 Request processed in 11911us (12104us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683406.253345:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1789683406.261590:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683406.261722:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802918400 00000100:00100000:2.0:1789683406.261731:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802918400 00010000:00010000:2.0:1789683406.261771:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0028 expref: 8 pid: 6676 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683406.261813:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:2.0:1789683406.261823:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802918400:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683406.261838:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683406.261861:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0028 expref: 8 pid: 6676 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.261875:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0028 expref: 8 pid: 6676 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.261897:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066bb3dd4/0x59bee33f93fecd0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0028 expref: 8 pid: 6676 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.261914:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683406.261940:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683406.261950:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.261962:0:7627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.262010:0:7627:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683406.262023:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7627:1876618815539200:192.168.203.60@tcp:105: 00000100:00100000:2.0:1789683406.262107:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5309f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683406.265501:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7627:1876618815539200:192.168.203.60@tcp:105: 00010000:00010000:2.0:1789683406.265528:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683406.265586:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802918400:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3763us (4005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683406.265600:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1789683406.268783:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683406.268871:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802918656 00000100:00100000:1.0:1789683406.268882:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802918656 00000100:00100000:1.0:1789683406.268940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1789683406.268950:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:10280:x1876618802918656:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:1.0:1789683406.269309:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10280:x1876618802918656:12345-192.168.203.60@tcp:35:bash.0 Request processed in 359us (533us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1789683406.269317:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1789683406.304042:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683406.304065:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815539328:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683406.304135:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683406.304187:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815539328 00000100:00100000:1.0:1789683406.304194:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815539328 00000100:00100000:1.0:1789683406.304263:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789683406.304273:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815539328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683406.304306:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683406.304363:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815539328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683406.304370:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1789683406.304394:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683406.304425:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815539328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683406.305258:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815539584:0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305301:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683406.305329:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789683406.305335:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815539456:0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305364:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683406.305391:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815539968:0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305413:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683406.305439:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815539456 00000100:00100000:0.0:1789683406.305444:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815539456 00000100:00100000:0.0:1789683406.305475:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789683406.305482:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815539456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305523:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815539456:12345-0@lo:400:kworker.0 Request processed in 41us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683406.305529:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789683406.305559:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815539840:0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305582:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683406.305600:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683406.305606:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815539712:0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305624:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683406.305654:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815539456:0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305707:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815539584 00000100:00100000:0.0:1789683406.305710:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815539584 00000100:00100000:0.0:1789683406.305731:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815539968 00000100:00100000:0.0:1789683406.305734:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815539968 00000100:00100000:0.0:1789683406.305769:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815539712 00000100:00100000:0.0:1789683406.305773:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815539712 00000100:00100000:0.0:1789683406.305787:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789683406.305793:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305828:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815539584:12345-0@lo:400:kworker.0 Request processed in 35us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683406.305834:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789683406.305846:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789683406.305852:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815539968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305879:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815539968:12345-0@lo:400:kworker.0 Request processed in 28us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683406.305885:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789683406.305896:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789683406.305902:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815539712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305930:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815539712:12345-0@lo:400:kworker.0 Request processed in 29us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683406.305935:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789683406.305959:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815539712:0@lo:400:kworker.0 00000100:00100000:0.0:1789683406.305979:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815539968:0@lo:400:kworker.0 00000100:00100000:2.0:1789683406.306771:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815539840 00000100:00100000:2.0:1789683406.306777:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815539840 00000100:00100000:2.0:1789683406.306813:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789683406.306820:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815539840:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789683406.306912:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683406.306917:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683406.308580:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815539584:0@lo:400:kworker.0 00000100:00100000:2.0:1789683406.311062:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815539840:12345-0@lo:400:kworker.0 Request processed in 4235us (5471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683406.311078:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789683406.313352:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815539840:0@lo:400:kworker.0 00010000:00010000:0.0:1789683406.371489:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683406.381156:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683406.381249:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802918912 00000100:00100000:0.0:1789683406.381260:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802918912 00000100:00100000:0.0:1789683406.381321:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1789683406.381332:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10290:x1876618802918912:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683406.381372:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683406.381395:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fecde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0036 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683406.381491:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789683406.381615:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fecde lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0036 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.381629:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931e900) 00010000:00010000:0.0:1789683406.381632:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683406.381637:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fecde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0036 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.381649:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f000, rc 0) 00000100:00100000:0.0:1789683406.381746:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:10290:x1876618802918912:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 415us (601us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1789683406.381754:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:3.0:1789683406.385311:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683406.385424:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802919168 00000100:00100000:1.0:1789683406.385436:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802919168 00000100:00100000:1.0:1789683406.385498:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1789683406.385510:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:10290:x1876618802919168:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1789683406.385770:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:10290:x1876618802919168:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 261us (468us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789683406.385777:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000001:00100000:1.0:1789683406.430046:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000100:00100000:3.0:1789683406.505377:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683406.506065:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802919296 00000100:00100000:1.0:1789683406.506077:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802919296 00000100:00100000:1.0:1789683406.506144:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1789683406.506154:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:10296:x1876618802919296:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683406.506178:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683406.506207:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fecec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f003d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.506277:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2200/0x59bee33f93fecf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.506305:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2200/0x59bee33f93fecf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.506316:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2200/0x59bee33f93fecf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683406.506353:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789683406.506356:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789683406.506374:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2200/0x59bee33f93fecf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.506402:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fecec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f003d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.506422:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2200/0x59bee33f93fecf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f003d expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.506430:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683406.506433:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683406.506437:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e2200, rc 0) 00000100:00100000:1.0:1789683406.506503:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:10296:x1876618802919296:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 350us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683406.506510:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1789683406.512063:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683406.512176:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802919552 00000100:00100000:3.0:1789683406.512185:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802919552 00000100:00100000:3.0:1789683406.512259:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1789683406.512269:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:10296:x1876618802919552:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683406.512290:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683406.512310:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0044 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.512405:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fed01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.512419:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fed01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.512431:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fed01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683406.512442:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789683406.512559:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fecfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0044 expref: 20 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.512595:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fed01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0044 expref: 19 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.512604:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:3.0:1789683406.512608:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683406.512612:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8600, rc 0) 00000100:00100000:3.0:1789683406.512719:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10296:x1876618802919552:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 451us (666us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1789683406.512726:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1789683406.518375:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683406.518422:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683406.518523:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802919936 00000100:00100000:2.0:1789683406.518537:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802919936 00000100:00100000:1.0:1789683406.518539:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802919808 00000100:00100000:1.0:1789683406.518546:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802919808 00000100:00100000:2.0:1789683406.518627:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1789683406.518629:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:2.0:1789683406.518641:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:2352:x1876618802919936:12345-192.168.203.60@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1789683406.518643:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:10296:x1876618802919808:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683406.518668:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683406.518703:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683406.518718:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fed01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0044 expref: 20 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.518723:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f004b expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.518742:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:2.0:1789683406.518747:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683406.518804:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:2352:x1876618802919936:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 169us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683406.518812:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00010000:00010000:1.0:1789683406.518852:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.518867:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.518879:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683406.518892:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789683406.519021:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f004b expref: 21 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.519054:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f004b expref: 20 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.519062:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:1.0:1789683406.519065:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789683406.519067:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe820e2600, rc 0) 00000100:00100000:1.0:1789683406.519102:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:10296:x1876618802919808:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 464us (743us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1789683406.519113:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:3.0:1789683406.541798:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683406.543505:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802920064 00000100:00100000:2.0:1789683406.543522:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802920064 00000100:00100000:2.0:1789683406.543603:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1789683406.543614:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802920064:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:2.0:1789683406.543942:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.543972:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.543982:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789683406.543987:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683406.543992:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.544043:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.544073:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 6 pid: 6674 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683406.544089:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1876618815540096:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683406.544209:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5309f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683406.551304:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683406.551601:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802920192 00000100:00100000:0.0:1789683406.551617:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802920192 00002000:00100000:0.0:1789683406.551710:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8dbe76d00a80 x1876618802920192/t0(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:462/0 lens 504/0 e 0 to 0 dl 1789683417 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683406.551725:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe76d00a80 with x1876618802920192 ext(0->12) 00010000:00010000:0.0:1789683406.551738:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 7 pid: 6674 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.551770:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 7 pid: 6674 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789683406.551800:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dbe76d00a80 00000100:00100000:0.0:1789683406.551845:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1789683406.551856:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802920192:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:0.0:1789683406.553731:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2352:x1876618802920192:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 1866us (2425us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789683406.555275:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1876618815540096:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683406.555285:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:0.0:1789683406.555309:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8dbe76d00a80 x1876618802920192/t4294967299(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:462/0 lens 504/448 e 0 to 0 dl 1789683417 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00010000:00010000:2.0:1789683406.555313:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:0.0:1789683406.555346:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe76d00a80 with x1876618802920192 ext(0->12) 00010000:00010000:0.0:1789683406.555361:0:6680:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 9 pid: 6674 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.555387:0:6680:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 9 pid: 6674 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789683406.555396:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dbe76d00a80 00000100:00100000:1.0:1789683406.557872:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683406.558009:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802920320 00000100:00100000:3.0:1789683406.558021:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802920320 00010000:00010000:3.0:1789683406.558079:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 9 pid: 6674 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683406.558135:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1789683406.558147:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2353:x1876618802920320:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683406.558167:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789683406.558193:0:5815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789683406.558195:0:5815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789683406 00002000:00010000:3.0:1789683406.558198:0:5815:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789683406 00002000:00010000:3.0:1789683406.558200:0:5815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789683406 00010000:00010000:3.0:1789683406.558234:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 9 pid: 6674 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.558249:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 9 pid: 6674 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.558281:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a45b0fc/0x59bee33f93fecd7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f002f expref: 9 pid: 6674 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.558302:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683406.558307:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683406.558313:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.558325:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683406.558367:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683406.558445:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802920320:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 300us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683406.558452:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00010000:00010000:0.0:1789683406.558968:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.558981:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.559013:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.559041:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.559050:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.559057:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8ca00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683406.559061:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.559072:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.559086:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.559094:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000875fe17a/0x59bee33f93fed24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683406.559169:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802920064:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 15555us (17385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683406.559178:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1789683406.564784:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683406.565405:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802920576 00000100:00100000:3.0:1789683406.565421:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802920576 00000100:00100000:3.0:1789683406.565503:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1789683406.565516:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:10296:x1876618802920576:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:3.0:1789683406.565605:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f004b expref: 20 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683406.566293:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1789683406.566367:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1789683406.567414:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1789683406.573749:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.573791:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0021 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.573803:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.573861:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0021 expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.573880:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0021 expref: 24 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683406.573898:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1876618815540224:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683406.574069:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5309f3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683406.576845:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1876618815540224:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683406.576892:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683406.579810:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683406.581822:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802920704 00000100:00100000:2.0:1789683406.581847:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802920704 00010000:00010000:2.0:1789683406.581919:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0021 expref: 25 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683406.581975:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:2.0:1789683406.581996:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:2353:x1876618802920704:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683406.582261:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683406.582271:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0021 expref: 25 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.582289:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0021 expref: 25 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.582320:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fecbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0021 expref: 25 pid: 5831 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.582346:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:2.0:1789683406.582353:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.582365:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.582400:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.582447:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683406.582531:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:2353:x1876618802920704:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 545us (2735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683406.582539:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00010000:00010000:0.0:1789683406.582909:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.582921:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683406.583375:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1789683406.584050:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1789683406.584245:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1876618815540352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789683406.584330:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683406.584368:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683406.585183:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815540352 00000100:00100000:2.0:1789683406.585195:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815540352 00000100:00100000:2.0:1789683406.585262:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683406.585274:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876618815540352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789683406.585392:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876618815540352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 120us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683406.585399:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683406.587325:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1876618815540352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789683406.592891:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789683406.593305:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1876618815540480:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789683406.593395:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683406.593484:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815540480 00000100:00100000:0.0:1789683406.593494:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815540480 00000100:00100000:0.0:1789683406.593555:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683406.593566:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1876618815540480:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789683406.595385:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1876618815540480:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1814us (1983us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1789683406.595401:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683406.595442:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789683406.595487:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1876618815540480:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789683406.595577:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1789683406.597066:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.597085:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.597096:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.597123:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683406.597129:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.597139:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.597160:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:0.0:1789683406.597163:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789683406.597170:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.597176:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed2b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683406.597483:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789683406.599172:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789683406.599199:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 340230524788ns, next at 341230519577ns, rc = 0 00000001:00080000:0.0:1789683406.599215:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1789683406.599310:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931eb00) 00010000:00010000:0.0:1789683406.599315:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789683406.599327:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f004b expref: 28 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683406.599510:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:10296:x1876618802920576:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 33993us (34738us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789683406.599532:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000020:00080000:0.0:1789683406.599540:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789683406.606164:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683406.609599:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802920832 00000100:00100000:2.0:1789683406.609729:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802920832 00000100:00100000:2.0:1789683406.609884:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:2.0:1789683406.609897:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:10296:x1876618802920832:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683406.609931:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683406.609965:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0052 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.610060:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0052 expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.610079:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0052 expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683406.610131:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:2.0:1789683406.610135:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683406.610140:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d200, rc 0) 00000100:00100000:2.0:1789683406.610286:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:10296:x1876618802920832:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 391us (4137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683406.610294:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1789683406.619112:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683406.619916:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802921088 00000100:00100000:1.0:1789683406.619931:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802921088 00000100:00100000:1.0:1789683406.620051:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1789683406.620066:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe708a1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:10296:x1876618802921088:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1789683406.620392:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe708a1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:10296:x1876618802921088:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 330us (1301us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1789683406.620401:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1789683406.717491:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683406.719886:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802921344 00000100:00100000:0.0:1789683406.719929:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802921344 00000100:00100000:0.0:1789683406.720039:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1789683406.720054:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:10306:x1876618802921344:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683406.720090:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683406.720119:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fed39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0059 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683406.720241:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789683406.720400:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fed39 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0059 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.720416:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931e900) 00010000:00010000:0.0:1789683406.720419:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683406.720425:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fed39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0059 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683406.720444:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f000, rc 0) 00000100:00100000:0.0:1789683406.720533:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10306:x1876618802921344:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 483us (3057us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789683406.720541:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:3.0:1789683406.723226:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683406.725878:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802921472 00000100:00100000:1.0:1789683406.725899:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802921472 00000100:00100000:1.0:1789683406.725994:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1789683406.726009:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10306:x1876618802921472:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1789683406.726136:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726160:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726176:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726194:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726201:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726209:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726370:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726381:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726388:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683406.726443:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726458:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726464:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726472:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726479:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683406.726484:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726493:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726507:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683406.726510:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683406.726516:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726531:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726549:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726555:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726562:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726568:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683406.726571:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726578:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726586:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe46df9e00) 00010000:00010000:1.0:1789683406.726589:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683406.726592:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726599:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726617:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726624:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726636:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726642:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683406.726645:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726652:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726660:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683406.726663:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683406.726666:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.726863:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683406.726971:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10306:x1876618802921472:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 963us (3764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683406.726981:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1789683406.733393:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683406.733730:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802921728 00000100:00100000:0.0:1789683406.733755:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802921728 00000100:00100000:0.0:1789683406.733830:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1789683406.733846:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10306:x1876618802921728:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683406.734221:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10306:x1876618802921728:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 377us (842us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1789683406.734230:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1789683406.807306:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683406.807433:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802921984 00000100:00100000:1.0:1789683406.807448:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802921984 00000100:00100000:1.0:1789683406.807540:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1789683406.807553:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10309:x1876618802921984:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683406.807586:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683406.807615:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0060 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808020:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808050:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808065:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808083:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808091:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808099:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808294:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808305:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808312:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683406.808326:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789683406.808462:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808471:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808485:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808492:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683406.808498:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808507:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808521:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683406.808525:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683406.808530:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808537:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2a00/0x59bee33f93fed63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808553:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808560:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808566:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808571:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683406.808575:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808591:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808600:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe46df9e00) 00010000:00010000:1.0:1789683406.808602:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683406.808605:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808611:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2600/0x59bee33f93fed6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.808664:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e3600/0x59bee33f93fed5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0060 expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.810534:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0060 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.810554:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683406.810556:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683406.810561:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7600, rc 0) 00000100:00100000:1.0:1789683406.810687:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10309:x1876618802921984:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 3118us (3377us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1789683406.810709:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:3.0:1789683406.816829:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683406.817218:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802922112 00000100:00100000:1.0:1789683406.817231:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802922112 00000100:00100000:1.0:1789683406.817313:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:1.0:1789683406.817326:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10309:x1876618802922112:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:1.0:1789683406.817443:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.817468:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.818061:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.818108:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.818117:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.818126:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.818132:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683406.818138:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.818146:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.818161:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683406.818165:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683406.818171:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683406.818178:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683406.818302:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10309:x1876618802922112:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 976us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683406.818311:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1789683406.821163:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683406.821383:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802922368 00000100:00100000:0.0:1789683406.821397:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802922368 00000100:00100000:0.0:1789683406.821467:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1789683406.821480:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10309:x1876618802922368:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683406.822279:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:10309:x1876618802922368:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 799us (1127us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789683406.822289:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1789683407.344339:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683407.344385:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802922624 00000100:00100000:1.0:1789683407.344395:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802922624 00000100:00100000:1.0:1789683407.344471:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:1.0:1789683407.344484:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:10341:x1876618802922624:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:1.0:1789683407.344510:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1789683407.344521:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789683407.344534:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0067 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.346705:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fed8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.346733:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fed8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.346748:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fed8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683407.348007:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789683407.348398:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fed86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0067 expref: 37 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.348421:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fed8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0067 expref: 36 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.348446:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683407.348449:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683407.348454:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6000, rc 0) 00000100:00100000:1.0:1789683407.348934:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:10341:x1876618802922624:12345-192.168.203.60@tcp:101:cat.0 Request processed in 4450us (4602us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1789683407.348944:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:1.0:1789683407.363881:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683407.363917:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802922880 00000100:00100000:1.0:1789683407.363927:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802922880 00000100:00100000:1.0:1789683407.363993:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1789683407.364003:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:10341:x1876618802922880:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:1.0:1789683407.364339:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:10341:x1876618802922880:12345-192.168.203.60@tcp:35:cat.0 Request processed in 336us (467us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1789683407.364347:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1789683407.366329:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683407.374967:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802923008 00000100:00100000:1.0:1789683407.374992:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802923008 00000100:00100000:1.0:1789683407.375082:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1789683407.375096:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:2353:x1876618802923008:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683407.375115:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683407.375152:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fed8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0067 expref: 37 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.375168:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683407.375173:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683407.375267:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496c4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:2353:x1876618802923008:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 174us (8960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683407.375274:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00010000:00010000:2.0:1789683407.392946:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683407.443615:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:1.0:1789683407.443651:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1789683407.443707:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dbe4970b480 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1789683407.443713:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe76226500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe4970b780 00000020:00080000:1.0:1789683407.443717:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe76226b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe7d69e000 00000100:00100000:1.0:1789683407.444300:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815540608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789683407.444394:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683407.444496:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815540608 00000100:00100000:1.0:1789683407.444506:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815540608 00000100:00100000:1.0:1789683407.444575:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789683407.444587:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815540608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789683407.444625:0:6677:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:1.0:1789683407.444670:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aac66ce, atime: 0x6aac66ce, ctime: 0x6aac66ce, blocks: 0x1 00010000:00010000:1.0:1789683407.444706:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.444727:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1789683407.444733:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683407.444741:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.444763:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.444797:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.444806:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.447438:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789683407.447798:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683407.447809:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.447825:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6000 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683407.447831:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.447845:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.447873:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.447881:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e47b958/0x59bee33f93fed9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.447941:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683407.447943:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683407.447945:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789683407.448610:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:1.0:1789683407.449828:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1876618815540608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 5236us (5427us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1789683407.449841:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00080000:3.0:1789683407.450064:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00080000:2.0:1789683407.450454:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe76d01180/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789683407.450463:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815540608:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789683407.502752:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683407.502879:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802923264 00000100:00100000:2.0:1789683407.502893:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802923264 00000100:00100000:2.0:1789683407.503083:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1789683407.503100:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10347:x1876618802923264:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:2.0:1789683407.503148:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683407.503153:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789683407.503189:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe820e2200/0x59bee33f93fecf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f003d expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.503226:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:2.0:1789683407.503233:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683407.503251:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93feda2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f006e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.503391:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.503410:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0060 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.503437:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.503502:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0060 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683407.503518:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0060 expref: 14 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683407.503536:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815540736:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683407.503667:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53d55540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683407.509656:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683407.509968:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802923392 00000100:00100000:0.0:1789683407.509983:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802923392 00010000:00010000:0.0:1789683407.510059:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0060 expref: 15 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683407.510111:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:0.0:1789683407.510125:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:2352:x1876618802923392:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683407.510145:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683407.510154:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0060 expref: 15 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683407.510170:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0060 expref: 15 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683407.510335:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:0.0:1789683407.510343:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683407.510355:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683407.510381:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683407.510405:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683407.510484:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:2352:x1876618802923392:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 361us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683407.510492:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00010000:00010000:3.0:1789683407.513512:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93fed71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0060 expref: 14 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683407.513549:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815540736:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683407.513588:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.513600:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.513607:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683407.513637:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789683407.513963:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93feda2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f006e expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.513986:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f006e expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.514027:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:3.0:1789683407.514031:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789683407.514036:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d600, rc 0) 00000100:00100000:3.0:1789683407.514137:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10347:x1876618802923264:12345-192.168.203.60@tcp:101:dd.0 Request processed in 11039us (11398us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1789683407.514149:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1789683407.519584:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683407.519750:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802923648 00000100:00100000:1.0:1789683407.519766:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802923648 00000100:00100000:1.0:1789683407.519844:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:1.0:1789683407.519857:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10347:x1876618802923648:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:1.0:1789683407.520411:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.520436:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.520453:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683407.520752:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1789683407.520790:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fef5cc00 reply state 000000001f1134cf transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683407.520826:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683407.521143:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:10347:x1876618802923648:12345-192.168.203.60@tcp:36:dd.0 Request processed in 1285us (1576us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1789683407.521157:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000020:00080000:1.0:1789683407.521164:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789683407.533357:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.533383:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.533393:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.533400:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683407.533406:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.533415:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.533437:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:3.0:1789683407.533440:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683407.533446:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.533453:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93fedb7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683407.923133:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683407.923254:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802923776 00000100:00100000:1.0:1789683407.923271:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802923776 00000100:00100000:1.0:1789683407.923352:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:1.0:1789683407.923365:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:10361:x1876618802923776:12345-192.168.203.60@tcp:101:stat.0 00010000:00010000:1.0:1789683407.923398:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683407.923424:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93fedbe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0075 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.923512:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.923542:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.923559:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.923579:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.923588:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.923595:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.924181:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.924198:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f006e expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.924208:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.924256:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f006e expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.924275:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f006e expref: 17 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683407.924292:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f65880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815540864:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683407.924446:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe497f4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683407.929238:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683407.929356:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802924032 00000100:00100000:2.0:1789683407.929369:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802924032 00000100:00100000:2.0:1789683407.929443:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1789683407.929457:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:5585:x1876618802924032:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789683407.930219:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:5585:x1876618802924032:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 760us (994us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789683407.930230:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1789683407.937489:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f65880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815540864:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683407.937550:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683407.943668:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683407.944717:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802924160 00000100:00100000:1.0:1789683407.944731:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802924160 00010000:00010000:1.0:1789683407.944800:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f006e expref: 19 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683407.944856:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:1.0:1789683407.944868:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:2355:x1876618802924160:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683407.944910:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683407.944918:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f006e expref: 19 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.944934:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f006e expref: 19 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.944962:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93feda9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f006e expref: 19 pid: 5829 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.944983:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683407.944990:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.945001:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.945010:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683407.945058:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683407.945133:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:2355:x1876618802924160:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 267us (1484us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683407.945142:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00010000:00010000:3.0:1789683407.946226:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946242:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683407.946310:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789683407.946316:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683407.946372:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946387:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946398:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946405:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946412:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946417:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683407.946422:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946429:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946443:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:3.0:1789683407.946459:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683407.946465:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946471:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93fedc5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946490:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946496:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946502:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946506:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683407.946508:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946513:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946520:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe46df9300) 00010000:00010000:3.0:1789683407.946522:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683407.946524:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946530:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93fedcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946580:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93fedbe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0075 expref: 18 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946606:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0075 expref: 17 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683407.946614:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:3.0:1789683407.946617:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683407.946619:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6800, rc 0) 00000100:00100000:3.0:1789683407.946850:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:10361:x1876618802923776:12345-192.168.203.60@tcp:101:stat.0 Request processed in 23487us (23734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683407.946859:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:3.0:1789683408.009501:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683408.009626:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802924416 00000100:00100000:2.0:1789683408.009640:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802924416 00000100:00100000:2.0:1789683408.009752:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:2.0:1789683408.009765:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:10367:x1876618802924416:12345-192.168.203.60@tcp:36:truncate.0 00010000:00010000:2.0:1789683408.009850:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683408.009889:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fedd3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0075 expref: 17 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.009944:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:2.0:1789683408.009950:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683408.010240:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.010257:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.010268:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683408.010321:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1789683408.010344:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d945ccdc reply state 00000000eacb3c4b transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683408.010353:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683408.010496:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10367:x1876618802924416:12345-192.168.203.60@tcp:36:truncate.0 Request processed in 732us (1008us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1789683408.010505:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000020:00080000:2.0:1789683408.010511:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789683408.013224:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.013247:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.013280:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.013287:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8ca00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683408.013294:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.013302:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.013324:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683408.013327:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683408.013333:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.013339:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fedda lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683408.251083:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.251412:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802924544 00000100:00100000:0.0:1789683408.251424:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802924544 00000100:00100000:0.0:1789683408.251497:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:0.0:1789683408.251508:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:10381:x1876618802924544:12345-192.168.203.60@tcp:101:stat.0 00010000:00010000:0.0:1789683408.251535:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683408.251556:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93fede1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f007c expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.251615:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.251629:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.251640:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.251655:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.251662:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.251708:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252178:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252188:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252194:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683408.252229:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789683408.252233:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683408.252255:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252266:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252274:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252280:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252286:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252291:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ee00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683408.252296:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252309:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252322:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683408.252324:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683408.252329:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252335:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93fede8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252347:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252352:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252357:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252362:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683408.252365:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252371:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252378:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe60aa2700) 00010000:00010000:0.0:1789683408.252380:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683408.252383:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252401:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fedef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252438:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93fede1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f007c expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252451:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f007c expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.252458:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:0.0:1789683408.252460:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683408.252463:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40fc00, rc 0) 00000100:00100000:0.0:1789683408.252953:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10381:x1876618802924544:12345-192.168.203.60@tcp:101:stat.0 Request processed in 1444us (1876us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683408.252963:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:2.0:1789683408.349372:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683408.349448:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802924800 00000100:00100000:3.0:1789683408.349458:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802924800 00000100:00100000:3.0:1789683408.349531:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:3.0:1789683408.349541:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10391:x1876618802924800:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683408.349561:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683408.349580:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fedfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0083 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683408.349659:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789683408.349933:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fedfd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0083 expref: 21 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.349948:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931e900) 00010000:00010000:3.0:1789683408.349951:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683408.349977:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fedfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0083 expref: 21 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.349992:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8200, rc 0) 00000100:00100000:3.0:1789683408.350061:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:10391:x1876618802924800:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 522us (698us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789683408.350069:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:3.0:1789683408.356305:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.358181:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802925056 00000100:00100000:0.0:1789683408.358196:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802925056 00000100:00100000:0.0:1789683408.358339:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1789683408.358350:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:10391:x1876618802925056:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683408.358665:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10391:x1876618802925056:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 309us (2360us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1789683408.358690:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:0.0:1789683408.415928:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683408.429086:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683408.429261:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802925312 00000100:00100000:3.0:1789683408.429271:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802925312 00000100:00100000:3.0:1789683408.429325:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:3.0:1789683408.429334:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10397:x1876618802925312:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683408.429357:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683408.429377:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee0b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f008a expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.429470:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.429498:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f007c expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.429507:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.429540:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f007c expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.429554:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f007c expref: 22 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683408.429579:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815540992:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683408.430374:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe62011300 going to sleep for 11 seconds 00000100:00100000:2.0:1789683408.435439:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.435661:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815540992:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683408.435701:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683408.435928:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802925440 00000100:00100000:3.0:1789683408.435935:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802925440 00010000:00010000:3.0:1789683408.436039:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f007c expref: 23 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683408.436111:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1789683408.436122:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:2353:x1876618802925440:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683408.436147:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683408.436154:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f007c expref: 23 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.436168:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f007c expref: 23 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.436187:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fedf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f007c expref: 23 pid: 5831 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.436203:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:3.0:1789683408.436208:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.436216:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.436234:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.436262:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683408.436313:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:2353:x1876618802925440:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 193us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683408.436321:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00010000:00010000:0.0:1789683408.436369:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.436377:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683408.436394:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1789683408.436548:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee0b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f008a expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.436564:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f008a expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.436572:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:0.0:1789683408.436575:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683408.436577:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9200, rc 0) 00000100:00100000:0.0:1789683408.436601:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:10397:x1876618802925312:12345-192.168.203.60@tcp:101:bash.0 Request processed in 7268us (7524us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789683408.436607:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1789683408.439334:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683408.439446:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802925696 00000100:00100000:1.0:1789683408.439457:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802925696 00000100:00100000:1.0:1789683408.439605:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:1.0:1789683408.439616:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:10397:x1876618802925696:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:1.0:1789683408.439941:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.439957:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.439971:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683408.440059:0:9827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1789683408.440084:0:9827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a003e529 reply state 00000000e33adc11 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683408.440093:0:9827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683408.440430:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:10397:x1876618802925696:12345-192.168.203.60@tcp:36:bash.0 Request processed in 813us (1103us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1789683408.440437:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000020:00080000:1.0:1789683408.440443:0:9827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789683408.442187:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.442202:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.442209:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.442215:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683408.442232:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.442239:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.442254:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:0.0:1789683408.442257:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683408.442262:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.442268:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fee20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683408.453749:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683408.454036:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802925824 00000100:00100000:3.0:1789683408.454046:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802925824 00000100:00100000:3.0:1789683408.454106:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:3.0:1789683408.454117:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:10397:x1876618802925824:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683408.454156:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683408.454180:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0091 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.454265:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.454281:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f008a expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.454290:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.454324:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f008a expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.454338:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f008a expref: 25 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683408.454364:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815541120:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683408.454460:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe620116c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683408.464038:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683408.464179:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a1b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815541120:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683408.464207:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683408.464874:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802925952 00000100:00100000:0.0:1789683408.464883:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802925952 00010000:00010000:0.0:1789683408.464934:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f008a expref: 26 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683408.464967:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1789683408.464976:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:2352:x1876618802925952:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683408.464992:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683408.464998:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f008a expref: 26 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.465021:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f008a expref: 26 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.465051:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee12 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f008a expref: 26 pid: 5830 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.465089:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:0.0:1789683408.465094:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.465105:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.465114:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.465143:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683408.465266:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:2352:x1876618802925952:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 289us (1252us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683408.465274:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00010000:00010000:3.0:1789683408.465287:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.465296:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683408.465347:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789683408.465351:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683408.465372:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.465403:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0091 expref: 25 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.467095:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0091 expref: 24 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.467106:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:3.0:1789683408.467108:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683408.467113:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9600, rc 0) 00000100:00100000:3.0:1789683408.467187:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:10397:x1876618802925824:12345-192.168.203.60@tcp:101:bash.0 Request processed in 13072us (13448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683408.467199:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:3.0:1789683408.472087:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683408.472644:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802926208 00000100:00100000:2.0:1789683408.472665:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802926208 00000100:00100000:2.0:1789683408.472755:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1789683408.472762:0:5833:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1789683408.472766:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe708a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:10397:x1876618802926208:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:0.0:1789683408.472771:0:5833:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:2.0:1789683408.473022:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe708a0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:10397:x1876618802926208:12345-192.168.203.60@tcp:35:bash.0 Request processed in 246us (933us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789683408.473030:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1789683408.562309:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.562412:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802926464 00000100:00100000:0.0:1789683408.562423:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802926464 00000100:00100000:0.0:1789683408.562480:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:0.0:1789683408.562491:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:10407:x1876618802926464:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683408.562516:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683408.562538:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93fee35 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0098 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683408.562666:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789683408.562825:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93fee35 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0098 expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.562857:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931e900) 00010000:00010000:0.0:1789683408.562860:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683408.562865:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93fee35 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0098 expref: 27 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.562879:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e800, rc 0) 00000100:00100000:0.0:1789683408.563161:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:10407:x1876618802926464:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 671us (859us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1789683408.563169:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:3.0:1789683408.566910:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683408.567006:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802926592 00000100:00100000:1.0:1789683408.567023:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802926592 00000100:00100000:1.0:1789683408.567085:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:1.0:1789683408.567095:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:10407:x1876618802926592:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1789683408.567182:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567197:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567209:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567229:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567253:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567260:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567659:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567845:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567856:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683408.567899:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567912:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567919:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567927:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567932:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683408.567936:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567943:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567961:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683408.567964:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683408.567969:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567975:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee43 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567987:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.567994:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568000:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568004:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683408.568007:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568023:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568030:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe46df9800) 00010000:00010000:1.0:1789683408.568032:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683408.568035:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568040:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee4a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568066:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568072:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568079:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568084:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683408.568087:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568093:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568100:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683408.568102:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683408.568105:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.568111:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fee51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683408.568220:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:10407:x1876618802926592:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1125us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683408.568229:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:1.0:1789683408.570370:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.570464:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802926848 00000100:00100000:0.0:1789683408.570474:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802926848 00000100:00100000:0.0:1789683408.570528:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1789683408.570537:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:10407:x1876618802926848:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683408.570955:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:10407:x1876618802926848:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 417us (590us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1789683408.570963:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1789683408.614930:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683408.615078:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802927104 00000100:00100000:3.0:1789683408.615092:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802927104 00000100:00100000:3.0:1789683408.615156:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:3.0:1789683408.615166:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:10410:x1876618802927104:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683408.615189:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683408.615210:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f009f expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615288:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615302:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615313:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615327:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615334:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615340:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615657:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fee6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615668:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fee6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615728:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fee6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683408.615738:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789683408.615827:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615836:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615843:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615849:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683408.615854:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615861:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615873:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:3.0:1789683408.615876:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683408.615881:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615887:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fee5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615898:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615905:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615917:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615922:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683408.615925:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615931:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615939:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe5931ef00) 00010000:00010000:3.0:1789683408.615941:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683408.615944:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.615950:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fee66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.616001:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fee58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f009f expref: 30 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.616025:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fee6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f009f expref: 29 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.616033:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:3.0:1789683408.616035:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683408.616037:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8400, rc 0) 00000100:00100000:3.0:1789683408.616106:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:10410:x1876618802927104:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 941us (1186us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1789683408.616124:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:3.0:1789683408.621807:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683408.621865:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683408.621968:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802927360 00000100:00100000:1.0:1789683408.621988:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802927360 00000100:00100000:1.0:1789683408.622076:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1789683408.622086:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:2355:x1876618802927360:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683408.622102:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683408.622124:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93fee6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f009f expref: 29 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.622142:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683408.622148:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683408.622200:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:2355:x1876618802927360:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 115us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683408.622207:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:2.0:1789683408.622314:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802927232 00000100:00100000:2.0:1789683408.622319:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802927232 00000100:00100000:2.0:1789683408.622352:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:2.0:1789683408.622359:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:10410:x1876618802927232:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:2.0:1789683408.622416:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.622430:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.622441:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.622466:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.622474:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.622870:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.622878:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683408.622883:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.622898:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.622907:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:2.0:1789683408.622909:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683408.622913:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.622918:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fee7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683408.622957:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:10410:x1876618802927232:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 599us (1159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683408.622964:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1789683408.626020:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.626103:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802927616 00000100:00100000:0.0:1789683408.626112:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802927616 00000100:00100000:0.0:1789683408.626160:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1789683408.626170:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:10410:x1876618802927616:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683408.626385:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:10410:x1876618802927616:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 216us (381us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1789683408.626392:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1789683408.819323:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683408.819436:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802927872 00000100:00100000:1.0:1789683408.819447:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802927872 00000100:00100000:1.0:1789683408.819511:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1789683408.819521:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:10428:x1876618802927872:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:1.0:1789683408.819545:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683408.819564:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee82 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00a6 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.819661:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee89 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.819705:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.819718:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee89 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683408.819758:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789683408.819885:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93fee82 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00a6 expref: 32 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.819904:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee89 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00a6 expref: 31 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.819911:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:1.0:1789683408.819914:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789683408.819917:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6400, rc 0) 00000100:00100000:1.0:1789683408.820380:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10428:x1876618802927872:12345-192.168.203.60@tcp:101:cat.0 Request processed in 859us (1064us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1789683408.820388:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:3.0:1789683408.861501:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.861604:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802928000 00000100:00100000:0.0:1789683408.861627:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802928000 00000100:00100000:0.0:1789683408.861708:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:0.0:1789683408.861718:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10429:x1876618802928000:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683408.861742:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683408.861763:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93fee97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00ad expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.861827:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fee9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.861839:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fee9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.861850:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fee9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683408.861884:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789683408.861887:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683408.861904:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fee9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.861930:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93fee97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00ad expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.861948:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fee9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00ad expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.861957:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683408.861959:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683408.861963:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ec00, rc 0) 00000100:00100000:0.0:1789683408.862053:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10429:x1876618802928000:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 336us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683408.862060:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:3.0:1789683408.873809:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.873907:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802928384 00000100:00100000:0.0:1789683408.873917:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802928384 00000100:00100000:0.0:1789683408.873984:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:0.0:1789683408.873996:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10429:x1876618802928384:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683408.874385:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10429:x1876618802928384:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 392us (585us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789683408.874393:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1789683408.878233:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683408.878410:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802928512 00000100:00100000:3.0:1789683408.878421:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802928512 00000100:00100000:3.0:1789683408.878498:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1789683408.878509:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10429:x1876618802928512:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:3.0:1789683408.878525:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789683408.878549:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fee2e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0091 expref: 33 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.878572:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fee89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00a6 expref: 32 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.878585:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93fed32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0052 expref: 31 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.878596:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:3.0:1789683408.878607:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683408.878764:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10429:x1876618802928512:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 256us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683408.878773:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:2.0:1789683408.888654:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683408.892191:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802928640 00000100:00100000:3.0:1789683408.892224:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802928640 00000100:00100000:2.0:1789683408.897871:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:2.0:1789683408.897895:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10429:x1876618802928640:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:2.0:1789683408.898055:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.898075:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.898319:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683408.899219:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683408.899420:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789683408.899492:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789683408.899607:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10429:x1876618802928640:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 1719us (10958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683408.899617:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000040:00080000:2.0:1789683408.928364:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683408.928372:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683408.928412:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789683408.928418:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683408.929804:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d00e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815541248:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789683408.929912:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7c40cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683408.933302:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683408.933658:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d00e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815541248:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789683408.933888:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802928768 00000100:00100000:1.0:1789683408.933896:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802928768 00000100:00100000:1.0:1789683408.933943:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:1.0:1789683408.933951:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10431:x1876618802928768:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683408.933968:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683408.933987:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93feeac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00b4 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934058:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934072:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934236:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934252:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934259:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934266:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934453:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934463:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934471:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683408.934515:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789683408.934519:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789683408.934534:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934544:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934553:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934569:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934575:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934581:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683408.934585:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934593:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934605:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683408.934608:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683408.934613:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934619:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93feeb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934631:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934637:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934643:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934648:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683408.934656:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934662:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934669:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe46df9800) 00010000:00010000:1.0:1789683408.934711:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683408.934715:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934721:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93feeba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934751:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93feeac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00b4 expref: 32 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934763:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00b4 expref: 31 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.934770:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:1.0:1789683408.934773:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683408.934775:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7400, rc 0) 00000100:00100000:1.0:1789683408.934831:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10431:x1876618802928768:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 880us (1539us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683408.934838:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:2.0:1789683408.938790:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683408.938896:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802928896 00000100:00100000:1.0:1789683408.938906:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802928896 00000100:00100000:1.0:1789683408.938952:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1789683408.938961:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10433:x1876618802928896:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1789683408.939060:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10433:x1876618802928896:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 Request processed in 99us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683408.939068:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1789683408.944488:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.944590:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802929024 00000100:00100000:0.0:1789683408.944600:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802929024 00000100:00100000:0.0:1789683408.944661:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:0.0:1789683408.944710:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10433:x1876618802929024:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789683408.944768:0:5831:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789683408.944871:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10433:x1876618802929024:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 201us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683408.944879:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:2.0:1789683408.947399:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.947661:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802929152 00000100:00100000:0.0:1789683408.947746:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802929152 00000100:00100000:0.0:1789683408.947799:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:0.0:1789683408.947808:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10433:x1876618802929152:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789683408.947873:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.947890:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.947914:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.947974:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.947982:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.947989:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948023:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948032:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948038:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683408.948076:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1789683408.948839:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683408.948857:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948871:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948878:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948899:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948905:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ee00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683408.948909:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948917:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948930:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:0.0:1789683408.948933:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683408.948938:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948944:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93feec8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948956:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948962:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948968:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948973:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683408.948976:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.948991:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.949646:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8dbe60aa2700) 00010000:00010000:0.0:1789683408.949651:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683408.949655:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.949662:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feecf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.949807:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.949815:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.949822:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.949827:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683408.949830:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.949837:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.949846:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:0.0:1789683408.949849:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683408.949852:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.949871:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feed6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683408.949973:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10433:x1876618802929152:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 2161us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683408.949982:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1789683408.954903:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683408.956494:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802929408 00000100:00100000:3.0:1789683408.956507:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802929408 00000100:00100000:3.0:1789683408.956581:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:3.0:1789683408.956593:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10433:x1876618802929408:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683408.956615:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683408.956637:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feedd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00bb expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.956776:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.956792:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.956804:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683408.956817:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1789683408.956912:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.956920:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.956927:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.956934:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683408.956938:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.956957:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.956968:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:3.0:1789683408.956971:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683408.956977:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.956983:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93feee4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.957032:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feedd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00bb expref: 33 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.957042:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:3.0:1789683408.957044:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683408.957048:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93feedd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00bb expref: 33 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683408.957058:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9600, rc 0) 00000100:00100000:3.0:1789683408.957129:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10433:x1876618802929408:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 539us (2234us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1789683408.957136:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:3.0:1789683408.959600:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683408.959718:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802929536 00000100:00100000:1.0:1789683408.959728:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802929536 00000100:00100000:1.0:1789683408.959776:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:1.0:1789683408.959787:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10433:x1876618802929536:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789683408.959839:0:6698:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789683408.959957:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10433:x1876618802929536:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 172us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683408.959965:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:2.0:1789683408.963958:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683408.964289:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802929792 00000100:00100000:0.0:1789683408.964300:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802929792 00000100:00100000:0.0:1789683408.964357:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:0.0:1789683408.964368:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10433:x1876618802929792:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683408.964388:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683408.964391:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789683408.964418:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93fee9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00ad expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.964437:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683408.964441:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683408.964453:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feef2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00c2 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683408.965468:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1789683408.965769:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.965784:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.965797:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.965865:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93feef2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c2 expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.965880:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c2 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683408.965888:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe60aa2700) 00010000:00010000:0.0:1789683408.965890:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683408.965893:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f200, rc 0) 00000100:00100000:0.0:1789683408.965957:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10433:x1876618802929792:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1591us (2009us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1789683408.966647:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:3.0:1789683408.969871:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683408.976279:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802930048 00000100:00100000:1.0:1789683408.976294:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802930048 00000100:00100000:1.0:1789683408.976362:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:1.0:1789683408.976371:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10433:x1876618802930048:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789683408.976425:0:9827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683408.976451:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93feef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c2 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976471:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe60aa2700) 00010000:00010000:1.0:1789683408.976493:0:9827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683408.976517:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976530:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976557:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976572:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976579:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976585:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976789:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976797:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976804:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976810:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683408.976814:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976821:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976830:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683408.976832:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683408.976836:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976847:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93fef07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976857:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976863:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976868:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976873:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683408.976876:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976881:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976888:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x773cce02 (ffff8dbe46df9800) 00010000:00010000:1.0:1789683408.976891:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683408.976894:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683408.976899:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93fef0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x773cce02 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683408.976991:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10433:x1876618802930048:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 620us (7128us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683408.976997:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:3.0:1789683408.982610:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683408.982841:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802930176 00000100:00100000:2.0:1789683408.982851:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802930176 00000100:00100000:2.0:1789683408.982908:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1789683408.982919:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10433:x1876618802930176:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683408.982939:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683408.982973:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00c9 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.983017:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.983030:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.983055:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.983149:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c9 expref: 34 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.983167:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c9 expref: 33 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.983175:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683408.983179:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683408.983182:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d600, rc 0) 00000100:00100000:2.0:1789683408.983232:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10433:x1876618802930176:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 315us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683408.983239:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1789683408.994478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683408.994575:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802930432 00000100:00100000:2.0:1789683408.994593:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802930432 00000100:00100000:2.0:1789683408.994644:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:2.0:1789683408.994654:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10433:x1876618802930432:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683408.994756:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.994773:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683408.994784:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683408.995067:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789683408.995077:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342626403782ns, next at 343626401074ns, rc = 0 00000004:00010000:2.0:1789683408.995229:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009022d9ad reply state 000000002e8a1362 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683408.995240:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683408.995384:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:10433:x1876618802930432:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 730us (913us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789683408.995392:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1789683409.000293:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:1.0:1789683409.000717:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.000730:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.000739:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.000745:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8da00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683409.000750:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.000758:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.000774:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683409.000776:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789683409.000782:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.000788:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.002222:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802930560 00000100:00100000:0.0:1789683409.002236:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802930560 00000100:00080000:1.0:1789683409.002278:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683409.002319:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1789683409.002330:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:10433:x1876618802930560:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683409.002352:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683409.002370:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00d0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.002426:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d0 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.002440:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d0 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.002483:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:0.0:1789683409.002486:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683409.002489:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f800, rc 0) 00000100:00100000:0.0:1789683409.002559:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:10433:x1876618802930560:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 231us (2276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683409.002566:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1789683409.007906:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683409.008062:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802930688 00000100:00100000:0.0:1789683409.008073:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802930688 00000100:00100000:0.0:1789683409.008162:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:0.0:1789683409.008170:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1876618802930688:12345-192.168.203.60@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1789683409.008205:0:6674:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp t0 exp 0000000000000000 cur 342 last 0 00000020:00000080:0.0:1789683409.008234:0:6674:0:(genops.c:1384:class_connect()) connect: client 54d6ac2c-8152-4eed-adb8-5b5d9e80a202, cookie 0x59bee33f93fef31 00002000:00100000:0.0:1789683409.008247:0:6674:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 54d6ac2c-8152-4eed-adb8-5b5d9e80a202/ffff8dbe76109000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789683409.008280:0:6674:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789683409.008506:0:6674:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789683409.008535:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8dbe7610f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683409.008776:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2351:x1876618802930688:12345-192.168.203.60@tcp:8:lhsmtool_posix.0 Request processed in 604us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683409.008784:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1789683409.021737:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683409.022063:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802930816 00000100:00100000:2.0:1789683409.022075:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802930816 00000100:00100000:2.0:1789683409.022165:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1789683409.022178:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:0:x1876618802930816:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1789683409.022224:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683409.126866:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:0:x1876618802930816:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 104683us (105137us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789683409.126879:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000001:00100000:3.0:1789683409.126911:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000001:00080000:3.0:1789683409.126923:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1789683409.130918:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.131443:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802931072 00000100:00100000:3.0:1789683409.131454:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802931072 00000100:00100000:3.0:1789683409.131524:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1789683409.131536:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:10433:x1876618802931072:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789683409.131792:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:10433:x1876618802931072:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 259us (880us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789683409.131800:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1789683409.139133:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683409.139590:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802931328 00000100:00100000:2.0:1789683409.139600:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802931328 00000100:00100000:2.0:1789683409.139667:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:2.0:1789683409.139695:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:10433:x1876618802931328:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683409.139941:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:10433:x1876618802931328:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 249us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.139949:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:3.0:1789683409.141946:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683409.142219:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802931456 00000100:00100000:2.0:1789683409.142229:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802931456 00000100:00100000:2.0:1789683409.142284:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:2.0:1789683409.142294:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:10433:x1876618802931456:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683409.142329:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683409.142349:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fef38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00d7 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.142415:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.142429:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.142442:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683409.142492:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683409.142511:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.142535:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93fef38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d7 expref: 38 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.142553:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d7 expref: 37 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.142561:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683409.142564:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789683409.142568:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8da00, rc 0) 00000100:00100000:2.0:1789683409.142625:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:10433:x1876618802931456:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 332us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.142631:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1789683409.145111:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683409.145173:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802931584 00000100:00100000:2.0:1789683409.145184:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802931584 00000100:00100000:2.0:1789683409.145238:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1789683409.145247:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2352:x1876618802931584:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683409.145264:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683409.145287:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00de expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789683409.145313:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac66d1, blocks: 0x1 00010000:00010000:2.0:1789683409.145329:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:2.0:1789683409.145333:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683409.145342:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00de expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.145360:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00de expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.145372:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c800, rc 0) 00000100:00100000:2.0:1789683409.145416:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802931584:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 170us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.145422:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1789683409.166497:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683409.166573:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802931840 00000100:00100000:1.0:1789683409.166590:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802931840 00000100:00100000:1.0:1789683409.166648:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:1.0:1789683409.166660:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:10433:x1876618802931840:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789683409.166808:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:10433:x1876618802931840:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 150us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683409.166825:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:3.0:1789683409.172895:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683409.173110:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802931968 00000100:00100000:1.0:1789683409.173119:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802931968 00000100:00100000:1.0:1789683409.173173:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:1.0:1789683409.173183:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:10433:x1876618802931968:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683409.173202:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683409.173223:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00e5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.173253:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00de expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.173262:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683409.173266:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683409.173272:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.173305:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00de expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.173317:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00de expref: 7 pid: 8465 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683409.173331:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6677:1876618815541376:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683409.173423:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe497f4f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683409.175702:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f67100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6677:1876618815541376:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683409.175746:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.175764:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6200, rc 0) 00000100:00100000:1.0:1789683409.175815:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:10433:x1876618802931968:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 2633us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683409.175823:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1789683409.180580:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.180655:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802932096 00000100:00100000:3.0:1789683409.180664:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802932096 00010000:00010000:3.0:1789683409.180735:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00de expref: 7 pid: 8465 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683409.180774:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1789683409.180785:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802932096:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683409.180800:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683409.180822:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00de expref: 7 pid: 8465 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.180845:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00de expref: 7 pid: 8465 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.180868:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f3b6f69/0x59bee33f93fef46 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00de expref: 7 pid: 8465 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.180884:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683409.180887:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683409.180895:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.180905:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.180941:0:5814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 6 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683409.180955:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5814:1876618815541504:192.168.203.60@tcp:105: 00000100:00100000:3.0:1789683409.181046:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe62011780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683409.185176:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683409.185285:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802932224 00000100:00100000:1.0:1789683409.185295:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802932224 00002000:00100000:1.0:1789683409.185341:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8dbe799cad80 x1876618802932224/t0(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:465/0 lens 504/0 e 0 to 0 dl 1789683420 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683409.185352:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe799cad80 with x1876618802932224 ext(0->8) 00002000:00010000:1.0:1789683409.185357:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe799cad80 00000100:00100000:0.0:1789683409.185702:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1789683409.185713:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802932224:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789683409.185845:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5814:1876618815541504:192.168.203.60@tcp:105: 00010000:00010000:3.0:1789683409.185867:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683409.185914:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e4450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802932096:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 5131us (5344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.185923:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:0.0:1789683409.187463:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802932224:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 1746us (2290us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1789683409.187476:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00002000:00100000:0.0:1789683409.187488:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8dbe799cad80 x1876618802932224/t4294967302(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:465/0 lens 504/448 e 0 to 0 dl 1789683420 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683409.187499:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe799cad80 with x1876618802932224 ext(0->8) 00002000:00010000:0.0:1789683409.187505:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe799cad80 00000100:00100000:0.0:1789683409.194627:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683409.194714:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802932352 00000100:00100000:2.0:1789683409.194733:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802932352 00000100:00100000:2.0:1789683409.194792:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1789683409.194802:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:10433:x1876618802932352:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789683409.276335:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967352 is committed 00000001:00080000:1.0:1789683409.276384:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:1.0:1789683409.276389:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:2.0:1789683409.280217:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:10433:x1876618802932352:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 85408us (85592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683409.280236:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1789683409.288556:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683409.288578:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815541632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789683409.288645:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683409.288736:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815541632 00000100:00100000:2.0:1789683409.288744:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815541632 00000100:00100000:2.0:1789683409.288796:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789683409.288805:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815541632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789683409.288957:0:8465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789683409.288961:0:8465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789683409 00002000:00010000:2.0:1789683409.288964:0:8465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789683409.288966:0:8465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789683409 -> 1789683409 00002000:00010000:2.0:1789683409.288968:0:8465:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789683409.289020:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815541632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 215us (374us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789683409.289028:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1789683409.289050:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789683409.289082:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe7b94ad80/2, rc 0, transno 4294967303 00000100:00100000:2.0:1789683409.289089:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815541632:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1789683409.289409:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1789683409.289424:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1789683409.289460:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1789683409.289471:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1789683409.289815:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.289885:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802932480 00000100:00100000:3.0:1789683409.289891:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802932480 00000100:00100000:3.0:1789683409.289931:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1789683409.289940:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802932480:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789683409.359231:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:0.0:1789683409.359250:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:3.0:1789683409.359582:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802932480:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 69637us (69762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.359593:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:0.0:1789683409.370653:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683409.370726:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802932736 00000100:00100000:1.0:1789683409.370736:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802932736 00000100:00100000:1.0:1789683409.370796:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1789683409.370807:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:10433:x1876618802932736:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789683409.370860:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683409.370889:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93fef3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d7 expref: 13 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.370913:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683409.370918:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683409.370950:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.370964:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.370973:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683409.371270:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2593e24 reply state 0000000033b42dea transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683409.371280:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683409.371470:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10433:x1876618802932736:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 665us (823us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1789683409.371478:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1789683409.379199:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683409.379220:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815541760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683409.379288:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683409.380174:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815541760 00000100:00100000:1.0:1789683409.380184:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815541760 00000100:00100000:1.0:1789683409.380242:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789683409.380254:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876618815541760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683409.380293:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683409.380372:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876618815541760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (1083us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683409.380388:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1789683409.380419:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683409.380895:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683409.380920:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802932864 00000100:00100000:0.0:1789683409.380925:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802932864 00000100:00100000:0.0:1789683409.380967:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1789683409.380976:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802932864:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789683409.381264:0:8465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789683409.381268:0:8465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789683409 -> 1789683408 00002000:00010000:0.0:1789683409.381270:0:8465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789683406 00002000:00010000:0.0:1789683409.381272:0:8465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789683409 -> 1789683408 00002000:00010000:0.0:1789683409.381275:0:8465:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789683409.381324:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802932864:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 349us (432us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789683409.381332:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00010000:00010000:2.0:1789683409.381651:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.381662:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.381690:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.381704:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683409.381710:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.381718:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.381735:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683409.381738:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683409.381743:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.381749:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93fef54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.383883:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815541760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683409.384390:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.384457:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802933120 00000100:00100000:3.0:1789683409.384464:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802933120 00000100:00100000:3.0:1789683409.384537:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:3.0:1789683409.384549:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:10433:x1876618802933120:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789683409.384752:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.384769:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c9 expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.384780:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.384871:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c9 expref: 13 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.384886:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c9 expref: 13 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683409.384900:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815541888:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683409.384985:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e830c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683409.388778:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683409.388858:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802933248 00000100:00100000:0.0:1789683409.388868:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802933248 00010000:00010000:0.0:1789683409.388908:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c9 expref: 14 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.388986:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1789683409.388996:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:2352:x1876618802933248:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683409.389021:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683409.389029:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c9 expref: 14 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.389043:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c9 expref: 14 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.389065:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:0.0:1789683409.389071:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.389082:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.389090:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.389111:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683409.389167:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:2352:x1876618802933248:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 171us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683409.389174:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00010000:00010000:3.0:1789683409.389309:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93fef1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00c9 expref: 13 pid: 6698 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683409.389327:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815541888:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683409.389346:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.389355:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.389361:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.389391:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.389399:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.389406:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.389412:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683409.389416:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.389423:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.389431:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:3.0:1789683409.389442:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789683409.389447:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.389453:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683409.389492:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:10433:x1876618802933120:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 4946us (5105us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789683409.389500:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:0.0:1789683409.395480:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.395656:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802933376 00000100:00100000:3.0:1789683409.395667:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802933376 00000100:00100000:2.0:1789683409.395795:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:2.0:1789683409.395807:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2355:x1876618802933376:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789683409.395853:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.395874:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.395883:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789683409.395888:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683409.395893:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.395939:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.395955:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 7 pid: 6677 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683409.395969:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6677:1876618815542016:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683409.396066:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b9520c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683409.406577:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.406726:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6677:1876618815542016:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683409.406754:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.407795:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802933504 00000100:00100000:0.0:1789683409.407805:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802933504 00010000:00010000:0.0:1789683409.407841:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 8 pid: 6677 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.407915:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1789683409.407925:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802933504:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683409.407941:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683409.407963:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 8 pid: 6677 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.407975:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 8 pid: 6677 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.408010:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062208589/0x59bee33f93fef4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00e5 expref: 8 pid: 6677 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.408027:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683409.408031:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683409.408037:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.408047:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.408080:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683409.408127:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.408139:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802933504:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 214us (1569us total) trans 0 rc 0/0 00010000:00010000:3.0:1789683409.408140:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.408158:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00010000:00010000:3.0:1789683409.408167:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.408177:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.408198:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.408205:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8ca00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683409.408209:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.408219:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.408231:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.408239:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000875fe17a/0x59bee33f93fef62 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683409.408292:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802933376:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 12487us (12821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.408301:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:2.0:1789683409.418301:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.418379:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802933760 00000100:00100000:3.0:1789683409.418390:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802933760 00000100:00100000:3.0:1789683409.418452:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1789683409.418463:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:10433:x1876618802933760:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789683409.418644:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.418705:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.418857:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.419154:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.419167:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d0 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.419175:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.419208:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d0 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.419223:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d0 expref: 13 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683409.419237:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815542144:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683409.419614:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e830c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789683409.440773:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683409.445761:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76c23b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815542144:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683409.445790:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683409.452167:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683409.453491:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802933888 00000100:00100000:0.0:1789683409.453503:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802933888 00010000:00010000:0.0:1789683409.453613:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d0 expref: 14 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.453657:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:0.0:1789683409.453667:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:2353:x1876618802933888:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683409.453704:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683409.453712:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d0 expref: 14 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.454618:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d0 expref: 14 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.454644:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fef2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00d0 expref: 14 pid: 5830 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.454660:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:0.0:1789683409.454665:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.454707:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.454715:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.454818:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683409.454891:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:2353:x1876618802933888:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1224us (2732us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683409.454900:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00010000:00010000:1.0:1789683409.455746:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.455759:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683409.456165:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1789683409.456310:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1789683409.456358:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1789683409.456462:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f67480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1876618815542272:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789683409.457812:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683409.457862:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5309f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683409.457928:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815542272 00000100:00100000:3.0:1789683409.457938:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815542272 00000100:00100000:3.0:1789683409.458077:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683409.458088:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1876618815542272:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789683409.458186:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1876618815542272:12345-0@lo:1000:mdt00_002.0 Request processed in 101us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.458202:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683409.458941:0:5831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1789683409.458949:0:5831:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe7b94ad80, transno 4294967303 00000100:00100000:1.0:1789683409.459129:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f67480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1876618815542272:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789683409.461118:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1789683409.461202:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f67480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1876618815542400:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789683409.461276:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683409.461309:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683409.461338:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815542400 00000100:00100000:1.0:1789683409.461344:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815542400 00000100:00100000:1.0:1789683409.461873:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683409.461884:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5831:x1876618815542400:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789683409.462107:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1876618815542400:12345-0@lo:1000:mdt00_002.0 Request processed in 225us (830us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789683409.462125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683409.465516:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f67480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1876618815542400:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789683409.465918:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.465928:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.465937:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.465942:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683409.465947:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.465955:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466042:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683409.466046:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683409.466051:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466057:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93fef70 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466093:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466099:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466116:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466121:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683409.466124:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466130:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466139:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:1.0:1789683409.466141:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683409.466144:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466149:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93feea5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466170:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466184:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00b4 expref: 16 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466192:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466227:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00b4 expref: 16 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.466241:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00b4 expref: 16 pid: 9827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683409.466261:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815542528:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683409.466343:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe627c5480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683409.469441:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.469597:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f65c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815542528:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683409.469624:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.470165:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802934016 00000100:00100000:0.0:1789683409.470173:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802934016 00010000:00010000:0.0:1789683409.470211:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00b4 expref: 17 pid: 9827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683409.470251:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1789683409.470261:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:2352:x1876618802934016:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683409.470275:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683409.470282:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00b4 expref: 17 pid: 9827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.470295:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00b4 expref: 17 pid: 9827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.470317:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93feec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00b4 expref: 17 pid: 9827 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.470330:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:0.0:1789683409.470346:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.470356:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.470364:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.470393:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683409.470449:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:2352:x1876618802934016:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 189us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683409.470457:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00010000:00010000:3.0:1789683409.471847:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.471863:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.471877:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.471884:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.471891:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.471897:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683409.471901:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.471908:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.471921:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:3.0:1789683409.471924:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683409.471929:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.471946:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93fef77 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.472039:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.472046:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.472052:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.472057:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683409.472059:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.472065:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.472073:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:3.0:1789683409.472076:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789683409.472079:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.472085:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683409.472371:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:10433:x1876618802933760:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 53905us (54075us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1789683409.472380:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000020:00080000:3.0:1789683409.472392:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789683409.477322:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.477479:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802934272 00000100:00100000:3.0:1789683409.477489:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802934272 00000100:00100000:3.0:1789683409.477555:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1789683409.477566:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:10433:x1876618802934272:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789683409.478495:0:11963:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789683409.478637:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1789683409.478856:0:11963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.478873:0:11963:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.478886:0:11963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.478896:0:11963:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.478903:0:11963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.478910:0:11963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683409.480155:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683409.480162:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683409.480187:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789683409.480192:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789683409.482035:0:11963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789683409.482173:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:10433:x1876618802934272:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 4603us (4853us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789683409.482183:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000020:00080000:1.0:1789683409.482190:0:11963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789683409.483712:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683409.483730:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.483740:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683409.483745:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.483755:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.483787:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8dbe5931ef00) 00010000:00010000:2.0:1789683409.483790:0:7626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789683409.483795:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.483802:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93fef7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683409.483820:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683409.483822:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683409.483824:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683409.740924:0:12003:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683409.740935:0:12003:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683409.740985:0:12003:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789683409.740990:0:12003:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683409.894291:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683409.894368:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802934528 00000100:00100000:0.0:1789683409.894379:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802934528 00000100:00100000:0.0:1789683409.894447:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:0.0:1789683409.894462:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:10452:x1876618802934528:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683409.894487:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683409.894510:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fef85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00ec expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.894611:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fef8c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.894626:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fef8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.894639:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fef8c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683409.894650:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789683409.894808:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93fef85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00ec expref: 20 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.894827:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fef8c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00ec expref: 19 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683409.894835:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683409.894838:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683409.894842:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f000, rc 0) 00000100:00100000:0.0:1789683409.894898:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10452:x1876618802934528:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 442us (617us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789683409.894904:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:0.0:1789683409.904443:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.904521:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802934656 00000100:00100000:3.0:1789683409.904531:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802934656 00000100:00100000:3.0:1789683409.904623:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:3.0:1789683409.904634:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10452:x1876618802934656:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:3.0:1789683409.904746:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.904775:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.904787:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.904804:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.904812:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.904819:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905205:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905215:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905223:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683409.905264:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905277:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905284:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905314:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905321:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683409.905325:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905334:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905346:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:3.0:1789683409.905349:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683409.905354:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905361:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fef9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905372:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905379:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905384:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905390:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683409.905393:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905408:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905416:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe5931e600) 00010000:00010000:3.0:1789683409.905418:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683409.905421:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905427:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefa1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905441:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905448:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905453:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905457:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683409.905460:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905465:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905471:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e000) 00010000:00010000:3.0:1789683409.905473:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683409.905476:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.905490:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefa8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683409.905572:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76128700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10452:x1876618802934656:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 937us (1136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683409.905580:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1789683409.970295:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683409.970378:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802934912 00000100:00100000:3.0:1789683409.970389:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802934912 00000100:00100000:3.0:1789683409.970446:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1789683409.970466:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10455:x1876618802934912:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683409.970486:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683409.970507:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00f3 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.970582:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.970597:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.970610:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.970623:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.970630:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.970636:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.970972:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.970981:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.970988:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683409.971011:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1789683409.971120:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971128:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971134:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971141:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683409.971145:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971154:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971168:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:3.0:1789683409.971171:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683409.971176:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971182:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93fefb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971202:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971208:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971214:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971220:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683409.971222:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971228:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971235:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe5931e000) 00010000:00010000:3.0:1789683409.971238:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683409.971241:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971246:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93fefbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971292:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93fefaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00f3 expref: 22 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971306:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00f3 expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683409.971324:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:3.0:1789683409.971326:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683409.971329:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9e00, rc 0) 00000100:00100000:3.0:1789683409.971406:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10455:x1876618802934912:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 941us (1119us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789683409.971415:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:2.0:1789683409.975765:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683409.975875:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802935040 00000100:00100000:1.0:1789683409.975894:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802935040 00000100:00100000:1.0:1789683409.975956:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:1.0:1789683409.975967:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10455:x1876618802935040:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:1.0:1789683409.976052:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.976070:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.976081:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.976116:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.976141:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.976147:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.976153:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683409.976158:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.976165:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.976178:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:1.0:1789683409.976181:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683409.976186:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683409.976191:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93fefd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683409.976266:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10455:x1876618802935040:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 300us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683409.976274:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:3.0:1789683409.979090:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683409.979255:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802935296 00000100:00100000:0.0:1789683409.979263:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802935296 00000100:00100000:0.0:1789683409.979314:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:0.0:1789683409.979324:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe708a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10455:x1876618802935296:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683409.979552:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe708a1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:10455:x1876618802935296:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 229us (471us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1789683409.979560:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1789683410.017285:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683410.017396:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802935552 00000100:00100000:2.0:1789683410.017408:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802935552 00000100:00100000:2.0:1789683410.017467:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:2.0:1789683410.017478:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:9983:x1876618802935552:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1789683410.017513:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683410.017534:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fefd9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f00fa expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.017637:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.017652:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00f3 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.017661:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.017821:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00f3 expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.017836:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00f3 expref: 23 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683410.017849:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815542656:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683410.018114:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683410.023174:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815542656:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683410.023214:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.024219:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.024417:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802935680 00000100:00100000:0.0:1789683410.024426:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802935680 00010000:00010000:0.0:1789683410.024465:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00f3 expref: 24 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683410.024513:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1789683410.024523:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:2353:x1876618802935680:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683410.024554:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683410.024561:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00f3 expref: 24 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.024573:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00f3 expref: 24 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.024592:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93fefc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00f3 expref: 24 pid: 5831 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.024606:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:0.0:1789683410.024611:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.024619:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.024626:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.024660:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683410.025164:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.025174:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683410.025194:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789683410.025339:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93fefd9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00fa expref: 25 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.025357:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00fa expref: 24 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.025364:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:2.0:1789683410.025367:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683410.025376:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c600, rc 0) 00000100:00100000:2.0:1789683410.025439:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:9983:x1876618802935552:12345-192.168.203.60@tcp:101:bash.0 Request processed in 7962us (8163us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789683410.025448:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:1.0:1789683410.026162:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:2353:x1876618802935680:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1636us (1944us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683410.026173:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:3.0:1789683410.029660:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.030011:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802935936 00000100:00100000:0.0:1789683410.030023:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802935936 00000100:00100000:0.0:1789683410.030075:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:0.0:1789683410.030083:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:9983:x1876618802935936:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:0.0:1789683410.030340:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.030464:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.030540:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683410.030600:0:6698:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1789683410.030624:0:6698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7c35970 reply state 00000000f4ce94c7 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683410.030632:0:6698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1789683410.030963:0:6698:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1789683410.031212:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:9983:x1876618802935936:12345-192.168.203.60@tcp:36:bash.0 Request processed in 1127us (1558us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1789683410.031219:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000020:00080000:0.0:1789683410.031224:0:6698:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1789683410.036206:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.036357:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802936064 00000100:00100000:0.0:1789683410.036369:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802936064 00000100:00100000:0.0:1789683410.036430:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:0.0:1789683410.036442:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:9983:x1876618802936064:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683410.036467:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683410.036490:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93feff5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0101 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.036560:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93feff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0101 expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.036576:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93feff5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0101 expref: 28 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.036596:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:0.0:1789683410.036608:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683410.036612:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e800, rc 0) 00000100:00100000:0.0:1789683410.036696:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:9983:x1876618802936064:12345-192.168.203.60@tcp:101:bash.0 Request processed in 235us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683410.036703:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1789683410.039170:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.039251:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802936192 00000100:00100000:0.0:1789683410.039262:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802936192 00000100:00100000:0.0:1789683410.039316:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:0.0:1789683410.039325:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:9983:x1876618802936192:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683410.039343:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683410.039364:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0108 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789683410.039392:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aac66d0, atime: 0x6aac66ce, ctime: 0x6aac66d0, blocks: 0xb 00010000:00010000:0.0:1789683410.039413:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:0.0:1789683410.039418:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683410.039426:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0108 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.039440:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0108 expref: 7 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.039453:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ee00, rc 0) 00000100:00100000:0.0:1789683410.039509:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:9983:x1876618802936192:12345-192.168.203.60@tcp:101:bash.0 Request processed in 185us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683410.039517:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1789683410.041542:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.041655:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802936320 00000100:00100000:0.0:1789683410.041666:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802936320 00002000:00010000:0.0:1789683410.041740:0:6680:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789683410.041745:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe7b94ad80 with x1876618802936320 ext(0->18446744073709551615) 00002000:00010000:0.0:1789683410.041756:0:6680:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe7b94ad80. 00000100:00100000:0.0:1789683410.041778:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1789683410.041787:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802936320:12345-192.168.203.60@tcp:10:bash.0 00002000:00010000:0.0:1789683410.042166:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789683410.042170:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789683408 -> 1789683410 00002000:00010000:0.0:1789683410.042173:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789683406 -> 1789683406 00002000:00010000:0.0:1789683410.042175:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789683408 -> 1789683410 00002000:00010000:0.0:1789683410.042177:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789683410.042238:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802936320:12345-192.168.203.60@tcp:10:bash.0 Request processed in 451us (704us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789683410.042246:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00010000:0.0:1789683410.042249:0:6680:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789683410.042252:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe7b94ad80 with x1876618802936320 ext(0->18446744073709551615) 00002000:00010000:0.0:1789683410.042257:0:6680:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe7b94ad80. 00010000:00010000:2.0:1789683410.044860:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.044877:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.044885:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.044891:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fc00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683410.044895:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.044902:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.044919:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:2.0:1789683410.044922:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683410.044927:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.044933:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93fefee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.131603:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683410.131763:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802936448 00000100:00100000:2.0:1789683410.131772:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802936448 00000100:00100000:2.0:1789683410.131888:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1789683410.131900:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:10469:x1876618802936448:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1789683410.132021:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132038:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132050:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132065:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132071:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132078:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132306:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132316:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132324:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683410.132366:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132378:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132393:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132399:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132405:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683410.132408:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132416:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132426:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:2.0:1789683410.132430:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683410.132434:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132440:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff003 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132452:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132458:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132464:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132469:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8da00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683410.132478:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132666:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132836:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe6097cc00) 00010000:00010000:2.0:1789683410.132839:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683410.132843:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132848:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff00a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132864:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132869:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132875:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132880:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683410.132883:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132888:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132895:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:2.0:1789683410.132897:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683410.132908:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.132914:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff011 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683410.133009:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:10469:x1876618802936448:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1102us (1405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683410.133018:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:1.0:1789683410.174791:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.174896:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802936704 00000100:00100000:0.0:1789683410.174907:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802936704 00000100:00100000:0.0:1789683410.174981:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:0.0:1789683410.174994:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:10472:x1876618802936704:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683410.175025:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683410.175047:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff018 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f010f expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175140:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175156:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175167:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175180:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175187:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175193:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175446:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff02d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175456:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175464:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff02d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683410.175474:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789683410.175582:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175590:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175603:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175609:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683410.175613:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175620:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175633:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683410.175636:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683410.175642:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175648:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff01f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175660:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175666:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175733:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175739:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683410.175742:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175760:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175770:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe60aa2300) 00010000:00010000:0.0:1789683410.175773:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683410.175776:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175783:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff026 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175825:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff018 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f010f expref: 30 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175839:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff02d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f010f expref: 29 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.175845:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:0.0:1789683410.175848:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789683410.175851:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40fc00, rc 0) 00000100:00100000:0.0:1789683410.175922:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:10472:x1876618802936704:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 930us (1138us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1789683410.175930:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:3.0:1789683410.186811:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.187039:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802936832 00000100:00100000:1.0:1789683410.187050:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802936832 00000100:00100000:1.0:1789683410.187114:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1789683410.187126:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:10472:x1876618802936832:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:1.0:1789683410.187215:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.187233:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00fa expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.187242:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.187277:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00fa expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.187292:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00fa expref: 29 pid: 5829 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683410.187306:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815542784:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683410.187407:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92900 going to sleep for 11 seconds 00000100:00100000:1.0:1789683410.189293:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815542784:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683410.189320:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.190347:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.190717:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802937088 00000100:00100000:1.0:1789683410.190726:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802937088 00000100:00100000:1.0:1789683410.190783:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1789683410.190792:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:5585:x1876618802937088:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789683410.191724:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:5585:x1876618802937088:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 928us (1378us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1789683410.191733:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:3.0:1789683410.196609:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.196713:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802937216 00000100:00100000:1.0:1789683410.196723:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802937216 00010000:00010000:1.0:1789683410.196763:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00fa expref: 31 pid: 5829 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683410.196795:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1789683410.196804:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:2353:x1876618802937216:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683410.196818:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683410.196825:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00fa expref: 31 pid: 5829 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.196838:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00fa expref: 31 pid: 5829 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.196860:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93fefe0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00fa expref: 31 pid: 5829 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.196876:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:1.0:1789683410.196881:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.196891:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.197145:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.197180:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683410.197270:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:2353:x1876618802937216:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 466us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683410.197278:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00010000:00010000:3.0:1789683410.198214:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.198226:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.198262:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.198270:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.198278:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.198294:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683410.198299:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.198307:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.198320:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:3.0:1789683410.198323:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683410.198327:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.198334:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff03b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.198390:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:10472:x1876618802936832:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 11266us (11588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683410.198398:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:2.0:1789683410.203755:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.204078:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802937472 00000100:00100000:1.0:1789683410.204088:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802937472 00000100:00100000:1.0:1789683410.204151:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:1.0:1789683410.204161:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:10472:x1876618802937472:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1789683410.204423:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10472:x1876618802937472:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 262us (677us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789683410.204431:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1789683410.295092:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683410.295257:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802937728 00000100:00100000:2.0:1789683410.295267:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802937728 00000100:00100000:2.0:1789683410.295332:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:2.0:1789683410.295343:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:10483:x1876618802937728:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:2.0:1789683410.295374:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683410.295402:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff042 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0116 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.295501:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.295515:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.295526:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.295542:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.295549:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.295572:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.295885:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93ff057 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.295894:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93ff057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.295902:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93ff057 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683410.295913:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1789683410.296205:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296214:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296221:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296227:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683410.296232:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296240:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296253:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:2.0:1789683410.296256:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683410.296267:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296274:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff049 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296286:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296292:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296298:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296303:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8ca00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683410.296306:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296313:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296320:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe6097cc00) 00010000:00010000:2.0:1789683410.296322:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683410.296325:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296330:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff050 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296375:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff042 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0116 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296401:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93ff057 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0116 expref: 32 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.296408:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:2.0:1789683410.296411:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683410.296414:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c800, rc 0) 00000100:00100000:2.0:1789683410.296555:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10483:x1876618802937728:12345-192.168.203.60@tcp:101:cat.0 Request processed in 1213us (1472us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1789683410.296564:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:3.0:1789683410.303900:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.312572:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802937984 00000100:00100000:1.0:1789683410.312599:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802937984 00000100:00100000:1.0:1789683410.312703:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:1.0:1789683410.312716:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10483:x1876618802937984:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:1.0:1789683410.313097:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10483:x1876618802937984:12345-192.168.203.60@tcp:35:cat.0 Request processed in 382us (9203us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789683410.313105:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:3.0:1789683410.333270:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.333866:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802938240 00000100:00100000:0.0:1789683410.333878:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802938240 00000100:00100000:0.0:1789683410.334126:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:0.0:1789683410.334137:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10484:x1876618802938240:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:0.0:1789683410.334212:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789683410.334242:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93ff057 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0116 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334267:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff02d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f010f expref: 32 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334280:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93feff5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0101 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334290:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe5931e600) 00010000:00010000:0.0:1789683410.334300:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683410.334322:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334336:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334347:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334360:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334368:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334374:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334645:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334654:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.334661:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683410.335438:0:6698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1789683410.335449:0:6698:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 343966775370ns, next at 344966773070ns, rc = 0 00010000:00010000:0.0:1789683410.335517:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335528:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335536:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335544:0:6698:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335550:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335556:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335572:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683410.335591:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335604:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335611:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335617:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683410.335622:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335629:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335641:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683410.335644:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789683410.335648:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335654:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff073 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.335704:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.336217:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683410.336225:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.336233:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683410.336244:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.336252:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.336264:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683410.336267:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789683410.336271:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.336276:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff07a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.336297:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683410.336299:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683410.336300:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683410.338860:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.338942:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.338949:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683410.338978:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.338988:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.339015:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683410.339019:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683410.339023:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.339031:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff065 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683410.339052:0:6698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cfa1de65 reply state 00000000ac658938 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683410.339061:0:6698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683410.339392:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:10484:x1876618802938240:12345-192.168.203.60@tcp:36:rm.0 Request processed in 5253us (6128us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1789683410.339401:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00010000:00010000:3.0:1789683410.342263:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.342348:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.342357:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.342363:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fa00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683410.342381:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.342390:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.342407:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe60aa2300) 00010000:00010000:3.0:1789683410.342410:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683410.342415:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.342421:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff06c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.403267:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.403641:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802938496 00000100:00100000:1.0:1789683410.403652:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802938496 00000100:00100000:1.0:1789683410.403759:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:1.0:1789683410.403769:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:10490:x1876618802938496:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1789683410.403792:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683410.403810:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff081 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f011d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.403914:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.403928:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.403940:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.403963:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.403971:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.403978:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789683410.404506:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1789683410.405091:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405104:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405114:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405149:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405157:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405164:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405169:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683410.405174:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405193:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405205:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683410.405209:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683410.405214:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405221:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff088 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683410.405234:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006b4cec7c reply state 000000006edee478 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683410.405242:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789683410.405275:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff081 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f011d expref: 34 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405288:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f011d expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.405295:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe46df9700) 00010000:00010000:1.0:1789683410.405297:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683410.405300:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7800, rc 0) 00000100:00100000:1.0:1789683410.405377:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:10490:x1876618802938496:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1609us (2120us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1789683410.405386:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00010000:00010000:1.0:1789683410.407502:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.407530:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.407538:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.407544:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683410.407548:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.407557:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.407572:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe46df9800) 00010000:00010000:1.0:1789683410.407575:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683410.407580:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.407586:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff08f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.411213:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.412071:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802938624 00000100:00100000:0.0:1789683410.412082:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802938624 00000100:00100000:0.0:1789683410.412167:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:0.0:1789683410.412180:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802938624:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683410.412201:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683410.412223:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0124 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789683410.412251:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789683410.412287:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=344s v=(0 0) 00010000:00010000:0.0:1789683410.412291:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683410.412301:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0124 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789683410.412430:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789683410.412471:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0124 expref: 8 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.412494:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ec00, rc 0) 00000100:00100000:0.0:1789683410.412562:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802938624:12345-192.168.203.60@tcp:101:bash.0 Request processed in 385us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683410.412569:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:2.0:1789683410.415779:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.416042:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802938752 00000100:00100000:0.0:1789683410.416052:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802938752 00000100:00100000:0.0:1789683410.416114:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1789683410.416125:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:10490:x1876618802938752:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683410.416143:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683410.416161:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f012b expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.416192:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0124 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.416201:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683410.416204:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683410.416210:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 9 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.416258:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0124 expref: 9 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.416272:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0124 expref: 9 pid: 6676 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683410.416287:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7612a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1876618815542912:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683410.416449:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f2b600 going to sleep for 11 seconds 00000100:00100000:2.0:1789683410.419762:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.420134:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7612a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8465:1876618815542912:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683410.420172:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 9 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.420191:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e600, rc 0) 00000100:00100000:0.0:1789683410.420242:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76247050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:10490:x1876618802938752:12345-192.168.203.60@tcp:101:bash.0 Request processed in 4119us (4473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683410.420252:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:3.0:1789683410.420613:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802938880 00000100:00100000:3.0:1789683410.420621:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802938880 00010000:00010000:3.0:1789683410.420651:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0124 expref: 9 pid: 6676 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.420792:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1789683410.420804:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2352:x1876618802938880:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683410.420817:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683410.420840:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0124 expref: 9 pid: 6676 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.420853:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0124 expref: 9 pid: 6676 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.421475:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c8393535/0x59bee33f93ff0a4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0124 expref: 9 pid: 6676 timeout: 444 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.421491:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683410.421495:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683410.421503:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 8 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.421513:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 8 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.421550:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 8 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.421564:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5816:1876618815543040:192.168.203.60@tcp:105: 00000100:00100000:3.0:1789683410.421631:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e83f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683410.425506:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760b3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5816:1876618815543040:192.168.203.60@tcp:105: 00010000:00010000:2.0:1789683410.425535:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683410.425592:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802938880:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 4791us (5839us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683410.425603:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:2.0:1789683410.429031:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.429158:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802939136 00000100:00100000:1.0:1789683410.429168:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802939136 00000100:00100000:1.0:1789683410.429273:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1789683410.429283:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:10490:x1876618802939136:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:1.0:1789683410.429664:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:10490:x1876618802939136:12345-192.168.203.60@tcp:35:bash.0 Request processed in 381us (640us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1789683410.429707:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00010000:00010000:0.0:1789683410.464554:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683410.623502:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.624448:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802939264 00000100:00100000:0.0:1789683410.624461:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802939264 00000100:00100000:0.0:1789683410.624544:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:0.0:1789683410.624556:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:10506:x1876618802939264:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683410.624589:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683410.624611:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff0b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0132 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.624878:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff0b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.624893:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.624905:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683410.624942:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789683410.624946:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683410.625133:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.625159:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff0b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0132 expref: 36 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.625177:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0132 expref: 35 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.625185:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683410.625189:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683410.625193:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40fc00, rc 0) 00000100:00100000:0.0:1789683410.625263:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:10506:x1876618802939264:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 709us (1778us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683410.625270:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:2.0:1789683410.631598:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.632201:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802939520 00000100:00100000:0.0:1789683410.632214:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802939520 00000100:00100000:0.0:1789683410.632346:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:0.0:1789683410.632358:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:10506:x1876618802939520:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683410.632383:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683410.632405:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff0c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0139 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.632531:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff0c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.632548:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.632560:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff0c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683410.632575:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789683410.632926:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff0c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0139 expref: 38 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.632945:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff0c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0139 expref: 37 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.632965:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe46df9700) 00010000:00010000:0.0:1789683410.632968:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683410.632972:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ec00, rc 0) 00000100:00100000:0.0:1789683410.633052:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:10506:x1876618802939520:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 696us (1465us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789683410.633060:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:3.0:1789683410.636626:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683410.637398:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683410.637421:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802939648 00000100:00100000:3.0:1789683410.637431:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802939648 00000100:00100000:3.0:1789683410.637504:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:3.0:1789683410.637515:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:2352:x1876618802939648:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683410.637530:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683410.637553:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff0c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0139 expref: 37 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.637584:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe46df9700) 00010000:00010000:3.0:1789683410.637589:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683410.637638:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:2352:x1876618802939648:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 125us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683410.637645:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1789683410.639162:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802939904 00000100:00100000:2.0:1789683410.639172:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802939904 00000100:00100000:2.0:1789683410.639268:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1789683410.639278:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:10506:x1876618802939904:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683410.639301:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683410.639319:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff0d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0140 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.639424:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff0dc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.639438:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff0dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.639449:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff0dc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683410.639461:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789683410.639598:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff0d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0140 expref: 39 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.639617:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff0dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0140 expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.639624:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe46df9700) 00010000:00010000:2.0:1789683410.639628:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789683410.639631:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d000, rc 0) 00000100:00100000:2.0:1789683410.639702:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+38:10506:x1876618802939904:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 425us (3084us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789683410.640006:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:3.0:1789683410.645054:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683410.645119:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802940032 00000100:00100000:3.0:1789683410.645128:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802940032 00000100:00100000:3.0:1789683410.645178:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1789683410.645188:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802940032:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:3.0:1789683410.645231:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.645250:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 8 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.645259:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683410.645263:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683410.645268:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.645302:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 8 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.645317:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 8 pid: 8465 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.645347:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6676:1876618815543168:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683410.645426:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e83180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683410.648216:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683410.648256:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802940160 00000100:00100000:3.0:1789683410.648265:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802940160 00002000:00100000:3.0:1789683410.648316:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8dbe760b1f80 x1876618802940160/t0(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:466/0 lens 504/0 e 0 to 0 dl 1789683421 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683410.648328:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe760b1f80 with x1876618802940160 ext(0->8) 00010000:00010000:3.0:1789683410.648337:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 9 pid: 8465 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.648354:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 9 pid: 8465 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683410.648362:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dbe760b1f80 00000100:00100000:3.0:1789683410.648394:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1789683410.648404:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2353:x1876618802940160:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:3.0:1789683410.648875:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:2353:x1876618802940160:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 470us (665us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1789683410.648883:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00002000:00100000:3.0:1789683410.648891:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8dbe760b1f80 x1876618802940160/t4294967302(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:466/0 lens 504/448 e 0 to 0 dl 1789683421 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683410.648899:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe760b1f80 with x1876618802940160 ext(0->8) 00010000:00010000:3.0:1789683410.648911:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 11 pid: 8465 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.648924:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 11 pid: 8465 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683410.648932:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dbe760b1f80 00000100:00100000:3.0:1789683410.648979:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760b1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6676:1876618815543168:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683410.649014:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.651424:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683410.651494:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802940288 00000100:00100000:3.0:1789683410.651503:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802940288 00010000:00010000:3.0:1789683410.651537:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 11 pid: 8465 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.651572:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:3.0:1789683410.651581:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:2354:x1876618802940288:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683410.651594:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789683410.651611:0:5815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789683410.651614:0:5815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789683410 00002000:00010000:3.0:1789683410.651616:0:5815:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789683411 00002000:00010000:3.0:1789683410.651618:0:5815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789683410 00010000:00010000:3.0:1789683410.651624:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 11 pid: 8465 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.651654:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 11 pid: 8465 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.651693:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c354f1c/0x59bee33f93ff0ab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f012b expref: 11 pid: 8465 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.651821:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683410.651827:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683410.651833:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.651843:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.651870:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683410.651914:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2354:x1876618802940288:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 334us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683410.651922:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00010000:00010000:3.0:1789683410.651946:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.651967:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.651989:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.652012:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.652020:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.652026:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683410.652030:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.652039:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.652050:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.652057:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ff0ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.652100:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2352:x1876618802940032:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 6914us (7057us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683410.652107:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:3.0:1789683410.654422:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683410.654506:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802940544 00000100:00100000:2.0:1789683410.654515:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802940544 00000100:00100000:2.0:1789683410.654567:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1789683410.654576:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe708a3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+38:10506:x1876618802940544:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:2.0:1789683410.654643:0:11963:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff0dc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0140 expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683410.654973:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1789683410.655031:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1789683410.655344:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1789683410.655398:0:11963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.655415:0:11963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f011d expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.655423:0:11963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.655459:0:11963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f011d expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.655474:0:11963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f011d expref: 42 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683410.655487:0:11963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11963:1876618815543296:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683410.655559:0:11963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b9526c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683410.659081:0:11963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7d6ab100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11963:1876618815543296:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683410.659128:0:11963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683410.659573:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683410.660015:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802940672 00000100:00100000:3.0:1789683410.660024:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802940672 00010000:00010000:3.0:1789683410.660062:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f011d expref: 43 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.660103:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:3.0:1789683410.660113:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+43:2353:x1876618802940672:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683410.660126:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683410.660132:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f011d expref: 43 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.660143:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f011d expref: 43 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.660164:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff096 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f011d expref: 43 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.660181:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe46df9700) 00010000:00010000:3.0:1789683410.660185:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.660194:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.660202:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.660330:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683410.660385:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+42:2353:x1876618802940672:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 273us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683410.660393:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00010000:00010000:0.0:1789683410.663073:0:11963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.663111:0:11963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683410.663244:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1789683410.663454:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1789683410.663651:0:11963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7612a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11963:1876618815543424:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789683410.664047:0:11963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683410.664125:0:11963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f2bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683410.664171:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815543424 00000100:00100000:1.0:1789683410.664180:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815543424 00000100:00100000:1.0:1789683410.664234:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683410.664243:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11963:x1876618815543424:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789683410.664366:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76128000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11963:x1876618815543424:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 124us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683410.664374:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683410.664475:0:11963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7612a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11963:1876618815543424:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1789683410.665328:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1789683410.665400:0:11963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7612a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11963:1876618815543552:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1789683410.665444:0:11963:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683410.665936:0:11963:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f2b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683410.666043:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815543552 00000100:00100000:1.0:1789683410.666050:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815543552 00000100:00100000:1.0:1789683410.666097:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683410.666105:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:11963:x1876618815543552:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1789683410.666320:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:11963:x1876618815543552:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 215us (874us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1789683410.666329:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683410.666941:0:11963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7612a300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11963:1876618815543552:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1789683410.667101:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789683410.667153:0:11963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.667165:0:11963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.667173:0:11963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.667179:0:11963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8da00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683410.667184:0:11963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.667209:0:11963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.667223:0:11963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe46df9700) 00010000:00010000:0.0:1789683410.667226:0:11963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789683410.667232:0:11963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.667238:0:11963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff0f1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11963 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683410.667421:0:11963:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789683410.667630:0:11963:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789683410.667643:0:11963:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 344298969386ns, next at 345298967263ns, rc = 0 00000001:00080000:0.0:1789683410.667650:0:11963:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789683410.668083:0:11963:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe46df9700) 00010000:00010000:0.0:1789683410.668088:0:11963:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789683410.668095:0:11963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff0dc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0140 expref: 46 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683410.668233:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe708a3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+45:10506:x1876618802940544:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 13656us (13817us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789683410.668242:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000020:00080000:0.0:1789683410.668248:0:11963:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789683410.671131:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.671226:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802940800 00000100:00100000:0.0:1789683410.671237:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802940800 00000100:00100000:0.0:1789683410.671325:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:0.0:1789683410.671335:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+45:10506:x1876618802940800:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683410.671374:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683410.671395:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff0f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0147 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.671455:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0147 expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.671471:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff0f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0147 expref: 46 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.671488:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:0.0:1789683410.671491:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683410.671494:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e800, rc 0) 00000100:00100000:0.0:1789683410.671596:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+46:10506:x1876618802940800:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 262us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683410.671603:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:2.0:1789683410.674591:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.674668:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802941056 00000100:00100000:1.0:1789683410.674703:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802941056 00000100:00100000:1.0:1789683410.674771:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1789683410.674781:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+46:10506:x1876618802941056:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1789683410.675027:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+47:10506:x1876618802941056:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 246us (445us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789683410.675035:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:1.0:1789683410.755736:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683410.755872:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802941184 00000100:00100000:2.0:1789683410.755882:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802941184 00000100:00100000:2.0:1789683410.755932:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:2.0:1789683410.755941:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+47:10516:x1876618802941184:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1789683410.756052:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756070:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756080:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756096:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756103:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756109:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756186:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756194:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756200:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683410.756240:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756252:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756269:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756276:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756282:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683410.756286:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756294:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756304:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:2.0:1789683410.756308:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683410.756312:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756319:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff0ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756338:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756344:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756349:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756354:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683410.756363:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756369:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756376:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe6097cc00) 00010000:00010000:2.0:1789683410.756379:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683410.756381:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756387:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff106 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756400:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756406:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756412:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756417:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683410.756420:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756425:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756432:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683410.756434:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683410.756442:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683410.756448:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff10d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683410.756523:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+47:10516:x1876618802941184:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 582us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683410.756530:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:2.0:1789683410.805891:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.806088:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802941440 00000100:00100000:1.0:1789683410.806099:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802941440 00000100:00100000:1.0:1789683410.806156:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:1.0:1789683410.806166:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+47:10519:x1876618802941440:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683410.806205:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683410.806226:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f014e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806299:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806314:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806325:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806338:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806345:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806351:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806461:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806471:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806478:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683410.806503:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789683410.806608:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806617:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806623:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806629:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683410.806633:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806640:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806652:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683410.806655:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683410.806660:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806666:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff11b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806719:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806726:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806732:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806737:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683410.806747:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806753:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806761:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe46df9800) 00010000:00010000:1.0:1789683410.806764:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683410.806766:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806772:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93ff122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806817:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff114 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f014e expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806830:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f014e expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.806838:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:1.0:1789683410.806840:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683410.806843:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7a00, rc 0) 00000100:00100000:1.0:1789683410.806915:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+49:10519:x1876618802941440:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 750us (1033us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789683410.806922:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 102 00000100:00100000:3.0:1789683410.810145:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.810242:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802941568 00000100:00100000:0.0:1789683410.810252:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802941568 00000100:00100000:0.0:1789683410.810309:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:0.0:1789683410.810319:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+49:10519:x1876618802941568:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:0.0:1789683410.810382:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.810398:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.810409:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.810453:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.810461:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.810468:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.810474:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fa00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683410.810478:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.810497:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.810510:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:0.0:1789683410.810514:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683410.810518:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.810525:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683410.810598:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+49:10519:x1876618802941568:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 280us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683410.810605:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:2.0:1789683410.813240:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.813315:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802941824 00000100:00100000:0.0:1789683410.813325:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802941824 00000100:00100000:0.0:1789683410.813379:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:0.0:1789683410.813402:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+49:10519:x1876618802941824:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683410.813643:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+50:10519:x1876618802941824:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 242us (410us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789683410.813651:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:3.0:1789683410.907134:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683410.907240:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802942080 00000100:00100000:0.0:1789683410.907250:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802942080 00000100:00100000:0.0:1789683410.907307:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:0.0:1789683410.907318:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+50:10529:x1876618802942080:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683410.907342:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683410.907345:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789683410.907371:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff0b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0132 expref: 50 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.907390:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683410.907395:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683410.907408:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff13e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0155 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.907839:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.907854:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f014e expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.907863:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.907897:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f014e expref: 50 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.907918:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f014e expref: 50 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683410.907931:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7612b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815543680:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683410.908033:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7d6b53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683410.914097:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.914287:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802942208 00000100:00100000:1.0:1789683410.914297:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802942208 00010000:00010000:1.0:1789683410.914336:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f014e expref: 51 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683410.914402:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:1.0:1789683410.914412:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+51:2353:x1876618802942208:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683410.914427:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683410.914434:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f014e expref: 51 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.914446:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f014e expref: 51 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.914467:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:1.0:1789683410.914473:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.914493:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.914502:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.914521:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683410.914592:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+51:2353:x1876618802942208:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 181us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683410.914599:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00010000:00010000:0.0:1789683410.917071:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff129 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f014e expref: 50 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683410.917095:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7612b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815543680:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683410.917118:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.917127:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.917133:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683410.917154:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789683410.917300:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff13e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0155 expref: 51 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.917316:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0155 expref: 50 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.917326:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:0.0:1789683410.917340:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683410.917344:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f800, rc 0) 00000100:00100000:0.0:1789683410.917406:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+50:10529:x1876618802942080:12345-192.168.203.60@tcp:101:bash.0 Request processed in 10089us (10280us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1789683410.917414:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:3.0:1789683410.922009:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683410.922101:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802942464 00000100:00100000:1.0:1789683410.922113:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802942464 00000100:00100000:1.0:1789683410.922170:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:1.0:1789683410.922182:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+50:10529:x1876618802942464:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:1.0:1789683410.922471:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.922487:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683410.922498:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683410.923022:0:9827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1789683410.923059:0:9827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ee6f470 reply state 000000009f587677 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683410.923069:0:9827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683410.923168:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+53:10529:x1876618802942464:12345-192.168.203.60@tcp:36:bash.0 Request processed in 988us (1174us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1789683410.923176:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000020:00080000:1.0:1789683410.923182:0:9827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789683410.925897:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.925922:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.925930:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.925936:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683410.925941:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.925949:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.925974:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:3.0:1789683410.925977:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683410.925982:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.925988:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7400/0x59bee33f93ff153 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683410.928503:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683410.928581:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802942592 00000100:00100000:3.0:1789683410.928592:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802942592 00000100:00100000:3.0:1789683410.928651:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:3.0:1789683410.928662:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+52:10529:x1876618802942592:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683410.928728:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683410.928762:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff15a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f015c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.928872:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.928887:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0155 expref: 53 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.928896:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.928940:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0155 expref: 53 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.928961:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0155 expref: 53 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.928973:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815543808:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683410.929052:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48e83180 going to sleep for 11 seconds 00000100:00100000:3.0:1789683410.932494:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760b3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815543808:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683410.932522:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683410.933231:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683410.933299:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802942720 00000100:00100000:3.0:1789683410.933306:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802942720 00010000:00010000:3.0:1789683410.933341:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0155 expref: 54 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683410.933382:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:3.0:1789683410.933391:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+54:2352:x1876618802942720:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683410.933405:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683410.933412:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0155 expref: 54 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.933424:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0155 expref: 54 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.933446:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff145 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0155 expref: 54 pid: 6698 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.933462:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:3.0:1789683410.933466:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.933476:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.933483:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683410.933512:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683410.933578:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+53:2352:x1876618802942720:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 187us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683410.933585:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00010000:00010000:0.0:1789683410.934021:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.934030:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683410.934073:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789683410.934078:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683410.934098:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.934129:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff15a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f015c expref: 53 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.934145:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f015c expref: 52 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683410.934152:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:0.0:1789683410.934155:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683410.934158:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9200, rc 0) 00000100:00100000:0.0:1789683410.934199:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+52:10529:x1876618802942592:12345-192.168.203.60@tcp:101:bash.0 Request processed in 5539us (5704us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683410.934205:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:2.0:1789683410.937517:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683410.937580:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802942976 00000100:00100000:3.0:1789683410.937590:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802942976 00000100:00100000:3.0:1789683410.937638:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1789683410.937646:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+52:10529:x1876618802942976:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:3.0:1789683410.937884:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+53:10529:x1876618802942976:12345-192.168.203.60@tcp:35:bash.0 Request processed in 237us (374us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1789683410.937892:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:2.0:1789683411.019431:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.019541:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802943104 00000100:00100000:0.0:1789683411.019566:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802943104 00000100:00100000:0.0:1789683411.019645:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:0.0:1789683411.019656:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+53:10535:x1876618802943104:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683411.019707:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683411.019728:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff168 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0163 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.019807:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff16f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.019822:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.019833:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683411.019867:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789683411.019871:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683411.019887:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.019914:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff168 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0163 expref: 55 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.019933:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0163 expref: 54 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.019941:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683411.019944:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789683411.020394:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40fc00, rc 0) 00000100:00100000:0.0:1789683411.020472:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+54:10535:x1876618802943104:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 817us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.020479:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00080000:2.0:1789683411.020939:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683411.026629:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.026742:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802943232 00000100:00100000:3.0:1789683411.026753:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802943232 00000100:00100000:3.0:1789683411.026813:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:3.0:1789683411.026823:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+54:10535:x1876618802943232:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683411.026844:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683411.026865:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff176 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f016a expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.026929:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.026944:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027074:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027093:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027115:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027123:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027265:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027276:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027284:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683411.027318:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1789683411.027322:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683411.027339:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027351:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027360:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027368:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027375:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027393:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683411.027397:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027405:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027417:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:3.0:1789683411.027420:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683411.027425:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027432:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff17d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027446:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027452:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027458:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027463:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683411.027466:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027471:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027867:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe5931e000) 00010000:00010000:3.0:1789683411.027870:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683411.027874:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027879:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff184 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027916:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff176 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 56 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027931:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 55 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.027938:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:3.0:1789683411.027940:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683411.027944:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8400, rc 0) 00000100:00100000:3.0:1789683411.028324:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10535:x1876618802943232:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1501us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.028333:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:3.0:1789683411.034052:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.034096:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.034169:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802943488 00000100:00100000:0.0:1789683411.034179:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802943488 00000100:00100000:0.0:1789683411.034237:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:0.0:1789683411.034248:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10535:x1876618802943488:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683411.034267:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683411.034296:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff192 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0171 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.034395:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.034410:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f015c expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.034418:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 56 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.034426:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.034459:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 56 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.034474:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 56 pid: 9827 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683411.034523:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7612b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815543936:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683411.034639:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f015c expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.034649:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f015c expref: 56 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683411.034658:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76128e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815544064:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683411.034700:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7d6b53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683411.034977:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802943616 00000100:00100000:2.0:1789683411.034982:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802943616 00010000:00010000:2.0:1789683411.035015:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 57 pid: 9827 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683411.035051:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:2.0:1789683411.035058:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+57:2352:x1876618802943616:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683411.035067:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683411.035074:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 57 pid: 9827 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.035086:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 57 pid: 9827 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.035116:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683411.035121:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.035128:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.035134:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683411.035159:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+57:2352:x1876618802943616:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 102us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.035167:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:3.0:1789683411.043352:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683411.043743:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802943744 00000100:00100000:1.0:1789683411.043754:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802943744 00010000:00010000:1.0:1789683411.043793:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f015c expref: 57 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683411.043839:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1789683411.043848:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+57:2353:x1876618802943744:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683411.043863:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683411.043870:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f015c expref: 57 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.043902:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f015c expref: 57 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.043923:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:1.0:1789683411.043929:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.043939:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.043947:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.043965:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683411.044039:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+57:2353:x1876618802943744:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 191us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683411.044046:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00010000:00010000:0.0:1789683411.044984:0:5829:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.60@tcp) returned -22 from blocking AST (req@000000001b6b234b x1876618815543936) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 56 pid: 9827 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.045013:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff18b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f016a expref: 56 pid: 9827 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683411.045029:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7612b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815543936:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683411.045046:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff161 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f015c expref: 55 pid: 5829 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683411.045056:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76128e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815544064:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683411.045075:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:0.0:1789683411.045082:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.045105:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.045111:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683411.045130:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789683411.045329:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff192 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0171 expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.045345:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0171 expref: 55 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.045353:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:0.0:1789683411.045355:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683411.045358:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e200, rc 0) 00000100:00100000:0.0:1789683411.045606:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10535:x1876618802943488:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 11358us (12095us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1789683411.045614:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:3.0:1789683411.054617:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.054737:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802944000 00000100:00100000:2.0:1789683411.054747:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802944000 00000100:00100000:2.0:1789683411.054861:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1789683411.054873:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10535:x1876618802944000:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:2.0:1789683411.054890:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683411.054913:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff0f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0147 expref: 55 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.054931:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683411.054935:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683411.055005:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+54:10535:x1876618802944000:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 134us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.055012:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1789683411.058032:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.058239:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802944128 00000100:00100000:0.0:1789683411.058249:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802944128 00000100:00100000:0.0:1789683411.058347:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:0.0:1789683411.058358:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+54:10535:x1876618802944128:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:0.0:1789683411.058624:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.058640:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.058662:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683411.058891:0:6698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1789683411.059651:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+54:10535:x1876618802944128:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 1290us (1703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.059662:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 110 00000100:00100000:0.0:1789683411.071577:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.071665:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802944256 00000100:00100000:3.0:1789683411.071720:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802944256 00000100:00100000:2.0:1789683411.073856:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:2.0:1789683411.073888:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+54:10535:x1876618802944256:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683411.073922:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683411.073953:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93ff1ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0178 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.074019:0:9827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.074031:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93ff1ae lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0178 expref: 55 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.074050:0:9827:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.074065:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93ff1ae lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0178 expref: 55 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.074078:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683411.074081:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683411.074085:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93ff1ae lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0178 expref: 55 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.074093:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c600, rc 0) 00000100:00100000:2.0:1789683411.074166:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76128e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10535:x1876618802944256:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 298us (2664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.074173:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 111 00000100:00100000:3.0:1789683411.106474:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.106784:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.107169:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802944384 00000100:00100000:2.0:1789683411.107179:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802944384 00000100:00100000:2.0:1789683411.107243:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 297 00000100:00100000:2.0:1789683411.107253:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802944384:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683411.107328:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802944384:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 77us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.107337:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 297 00000100:00100000:2.0:1789683411.108636:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.108699:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.108928:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802944768 00000100:00100000:0.0:1789683411.108935:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802944768 00000100:00100000:0.0:1789683411.109012:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:0.0:1789683411.109022:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802944768:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683411.109080:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802944768:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 60us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.109088:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00080000:3.0:1789683411.109288:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683411.115053:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802944512 00000100:00100000:1.0:1789683411.115068:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802944512 00000100:00100000:0.0:1789683411.115259:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802944640 00000100:00100000:0.0:1789683411.115264:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802944640 00000100:00080000:3.0:1789683411.115354:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683411.115396:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1789683411.115410:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2353:x1876618802944512:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683411.115510:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2353:x1876618802944512:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 103us (9045us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.115518:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:0.0:1789683411.115538:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1789683411.115544:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802944640:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683411.115571:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802944640:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 27us (6898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.115592:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:1.0:1789683411.424246:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815544448:0@lo:400:kworker.0 00000100:00100000:1.0:1789683411.424343:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683411.424443:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683411.424449:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815544576:0@lo:400:kworker.0 00000100:00100000:1.0:1789683411.424473:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1789683411.424647:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345055973311ns, next at 346055970761ns, rc = 0 00000100:00100000:2.0:1789683411.424686:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815544320:0@lo:400:kworker.0 00000100:00100000:2.0:1789683411.424716:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683411.424748:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815544832:0@lo:400:kworker.0 00000100:00100000:2.0:1789683411.424769:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683411.424793:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789683411.424798:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815544192:0@lo:400:kworker.0 00000100:00100000:2.0:1789683411.424826:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683411.424848:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815544704:0@lo:400:kworker.0 00000100:00100000:2.0:1789683411.424879:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683411.424899:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683411.424905:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815544960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683411.424925:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815544192 00000100:00100000:2.0:1789683411.424927:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683411.424933:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815544192 00000100:00100000:3.0:1789683411.424974:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789683411.424983:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815544192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683411.425044:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815544192:12345-0@lo:400:kworker.0 Request processed in 62us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.425050:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1789683411.425080:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815544576 00000100:00100000:3.0:1789683411.425084:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815544576 00000100:00100000:3.0:1789683411.425113:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815544832 00000100:00100000:3.0:1789683411.425115:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815544832 00000100:00100000:3.0:1789683411.425134:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789683411.425139:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1876618815544576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683411.425170:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3304:x1876618815544576:12345-0@lo:400:kworker.0 Request processed in 30us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.425176:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789683411.425188:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789683411.425379:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815544576:0@lo:400:kworker.0 00000100:00100000:1.0:1789683411.425401:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815544960 00000100:00100000:1.0:1789683411.425415:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815544960 00000100:00100000:1.0:1789683411.425441:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789683411.425447:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815544960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683411.425472:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683411.425521:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815544960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683411.425528:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789683411.425551:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815544448 00000100:00100000:1.0:1789683411.425555:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815544448 00000100:00100000:1.0:1789683411.425577:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815544320 00000100:00100000:1.0:1789683411.425580:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815544320 00000100:00100000:1.0:1789683411.425594:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815544704 00000100:00100000:1.0:1789683411.425596:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815544704 00000100:00100000:1.0:1789683411.425609:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789683411.425614:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815544448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683411.425647:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815544448:12345-0@lo:400:kworker.0 Request processed in 33us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683411.425654:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1789683411.425664:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789683411.425669:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815544320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683411.425714:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815544320:12345-0@lo:400:kworker.0 Request processed in 45us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683411.425719:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789683411.425731:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789683411.425736:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815544704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683411.425761:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815544704:12345-0@lo:400:kworker.0 Request processed in 25us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683411.425777:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789683411.425806:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815544448:0@lo:400:kworker.0 00000100:00080000:3.0:1789683411.433787:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683411.433795:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683411.433798:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683411.433824:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815544832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683411.433917:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815544832:12345-0@lo:400:kworker.0 Request processed in 8723us (9146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.433928:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789683411.434033:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53098000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815544960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683411.434093:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815544192:0@lo:400:kworker.0 00000100:00100000:3.0:1789683411.434123:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815544704:0@lo:400:kworker.0 00000100:00100000:3.0:1789683411.434135:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815544320:0@lo:400:kworker.0 00000100:00100000:3.0:1789683411.434144:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815544832:0@lo:400:kworker.0 00010000:00010000:0.0:1789683411.488769:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683411.500054:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1789683411.500075:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:1.0:1789683411.500087:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1789683411.500095:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000040:00080000:2.0:1789683411.554224:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683411.554233:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683411.554270:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789683411.554276:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683411.554394:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53098000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815545088:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789683411.554621:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683411.565655:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53098000 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815545088:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789683411.571423:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683411.571565:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802944896 00000100:00100000:1.0:1789683411.571576:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802944896 00000100:00100000:1.0:1789683411.571638:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1789683411.571649:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10536:x1876618802944896:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789683411.572639:0:5830:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789683411.572998:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10536:x1876618802944896:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 1339us (1574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683411.573009:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 112 00000100:00100000:1.0:1789683411.577804:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.578286:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802945024 00000100:00100000:0.0:1789683411.578295:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802945024 00000100:00100000:0.0:1789683411.578398:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:0.0:1789683411.578409:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10536:x1876618802945024:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789683411.578497:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.578519:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.578531:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.578593:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.578601:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.578608:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.578629:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.578637:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.578644:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683411.578971:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789683411.578977:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683411.579000:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579011:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579018:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579025:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579031:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fa00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683411.579036:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579043:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579055:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:0.0:1789683411.579058:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683411.579063:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579069:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff1b5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579082:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579100:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579107:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579112:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683411.579116:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579122:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579129:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8dbe60aa2f00) 00010000:00010000:0.0:1789683411.579131:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683411.579135:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579140:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1bc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579155:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579161:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579166:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579171:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683411.579180:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579187:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579194:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:0.0:1789683411.579197:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683411.579200:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.579206:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683411.579285:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10536:x1876618802945024:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 876us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.579293:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 113 00000100:00100000:3.0:1789683411.581421:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.581643:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802945280 00000100:00100000:2.0:1789683411.581655:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802945280 00000100:00100000:2.0:1789683411.581843:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:2.0:1789683411.581854:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:10536:x1876618802945280:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683411.581876:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683411.581895:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1ca lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f017f expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582105:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582120:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582132:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683411.582143:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789683411.582237:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582244:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582250:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582255:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683411.582259:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582283:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582295:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683411.582298:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789683411.582303:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582309:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582349:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1ca lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f017f expref: 57 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582359:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:2.0:1789683411.582361:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683411.582365:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1ca lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f017f expref: 57 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.582375:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8da00, rc 0) 00000100:00100000:2.0:1789683411.582476:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:10536:x1876618802945280:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 623us (1061us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1789683411.582493:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 114 00000100:00100000:0.0:1789683411.585425:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.585571:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802945408 00000100:00100000:2.0:1789683411.585581:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802945408 00000100:00100000:2.0:1789683411.585857:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:2.0:1789683411.585870:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:10536:x1876618802945408:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789683411.585921:0:5831:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789683411.586110:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:10536:x1876618802945408:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 242us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.586118:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 115 00000100:00100000:3.0:1789683411.589592:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.589929:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802945664 00000100:00100000:0.0:1789683411.589940:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802945664 00000100:00100000:0.0:1789683411.590106:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:0.0:1789683411.590117:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:10536:x1876618802945664:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683411.590138:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683411.590141:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789683411.590170:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff16f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0163 expref: 56 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.590189:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683411.590195:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683411.590222:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0186 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683411.590729:0:6698:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1789683411.590978:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.591001:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.591012:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.591065:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff1df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0186 expref: 58 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.591079:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0186 expref: 57 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.591085:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe60aa2f00) 00010000:00010000:0.0:1789683411.591088:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683411.591091:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f800, rc 0) 00000100:00100000:0.0:1789683411.591221:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+57:10536:x1876618802945664:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1105us (1637us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1789683411.591230:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 116 00000100:00100000:0.0:1789683411.595096:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.595175:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802945920 00000100:00100000:2.0:1789683411.595186:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802945920 00000100:00100000:2.0:1789683411.595249:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:2.0:1789683411.595260:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+57:10536:x1876618802945920:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683411.595317:0:9827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683411.595343:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff1e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0186 expref: 57 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595362:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe60aa2f00) 00010000:00010000:2.0:1789683411.595374:0:9827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683411.595397:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595412:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595422:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595498:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595507:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595536:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595600:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595607:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595614:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595620:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8da00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683411.595625:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595633:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595641:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:2.0:1789683411.595644:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683411.595648:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595654:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff1f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595664:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.595670:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.596108:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.596114:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683411.596117:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.596123:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.596130:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xb0a8bfc6 (ffff8dbe6097cc00) 00010000:00010000:2.0:1789683411.596133:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683411.596136:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.596141:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff1fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xb0a8bfc6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683411.596233:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76129c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:10536:x1876618802945920:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 973us (1145us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683411.596241:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 117 00000100:00100000:2.0:1789683411.599105:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683411.599198:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802946048 00000100:00100000:1.0:1789683411.599209:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802946048 00000100:00100000:1.0:1789683411.599265:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:1.0:1789683411.599274:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:10536:x1876618802946048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683411.599294:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683411.599318:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff202 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f018d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.599357:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.599390:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.599402:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.599507:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff202 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f018d expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.599527:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f018d expref: 57 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.599535:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:1.0:1789683411.599538:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789683411.599541:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7e00, rc 0) 00000100:00100000:1.0:1789683411.599609:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+57:10536:x1876618802946048:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 336us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683411.599616:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 118 00000100:00100000:1.0:1789683411.605920:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.606024:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802946304 00000100:00100000:0.0:1789683411.606034:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802946304 00000100:00100000:0.0:1789683411.606097:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:0.0:1789683411.606106:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+57:10536:x1876618802946304:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789683411.606210:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.606226:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.606239:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683411.606503:0:6698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1789683411.606591:0:6698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000da78e7f0 reply state 0000000084c0e394 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683411.606600:0:6698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683411.607045:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+59:10536:x1876618802946304:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 938us (1133us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1789683411.607053:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:3.0:1789683411.609430:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.609598:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802946432 00000100:00100000:2.0:1789683411.609608:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802946432 00000100:00100000:2.0:1789683411.609662:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:2.0:1789683411.609692:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+59:10536:x1876618802946432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683411.609716:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683411.610020:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.610032:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.610040:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.610045:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683411.610064:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.610072:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.610090:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:1.0:1789683411.610093:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789683411.610098:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.610103:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff210 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.610172:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0194 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.610239:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0194 expref: 59 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.610252:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0194 expref: 59 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.610271:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:2.0:1789683411.610274:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683411.610277:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d000, rc 0) 00000100:00100000:2.0:1789683411.610336:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+59:10536:x1876618802946432:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 665us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.610343:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 120 00000100:00100000:2.0:1789683411.613199:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683411.613289:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802946560 00000100:00100000:1.0:1789683411.613300:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802946560 00000100:00100000:1.0:1789683411.613396:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:1.0:1789683411.613406:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2355:x1876618802946560:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789683411.613954:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2355:x1876618802946560:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 541us (756us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789683411.613963:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:1.0:1789683411.617018:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.617197:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802946816 00000100:00100000:3.0:1789683411.617208:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802946816 00000100:00100000:3.0:1789683411.617259:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:3.0:1789683411.617269:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+59:10536:x1876618802946816:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789683411.617521:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:10536:x1876618802946816:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 252us (510us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1789683411.617529:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:0.0:1789683411.620001:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.620149:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802947072 00000100:00100000:2.0:1789683411.620159:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802947072 00000100:00100000:2.0:1789683411.620219:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:2.0:1789683411.620230:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:10536:x1876618802947072:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683411.620345:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76128380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:10536:x1876618802947072:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 117us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.620353:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 121 00000100:00100000:2.0:1789683411.624541:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.624782:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802947200 00000100:00100000:0.0:1789683411.624792:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802947200 00000100:00100000:0.0:1789683411.624846:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:0.0:1789683411.624857:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:10536:x1876618802947200:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683411.624878:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683411.624898:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff21e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f019b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.624981:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.625006:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.625033:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683411.625076:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683411.625095:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.625125:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff21e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f019b expref: 62 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.625143:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f019b expref: 61 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.625152:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:0.0:1789683411.625154:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789683411.625158:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ec00, rc 0) 00000100:00100000:0.0:1789683411.625228:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:10536:x1876618802947200:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 373us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.625234:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 122 00000100:00100000:1.0:1789683411.628799:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.629044:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802947328 00000100:00100000:3.0:1789683411.629054:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802947328 00000100:00100000:3.0:1789683411.629112:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1789683411.629122:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2355:x1876618802947328:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683411.629141:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683411.629162:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01a2 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683411.629189:0:6676:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac66d4, blocks: 0x1 00010000:00010000:3.0:1789683411.629206:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1789683411.629222:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683411.629230:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a2 expref: 10 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.629248:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a2 expref: 10 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.629261:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8200, rc 0) 00000100:00100000:3.0:1789683411.629323:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2355:x1876618802947328:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 203us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.629330:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:2.0:1789683411.632480:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.632869:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802947584 00000100:00100000:3.0:1789683411.632879:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802947584 00000100:00100000:0.0:1789683411.633108:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:0.0:1789683411.633121:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:10536:x1876618802947584:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789683411.633233:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:10536:x1876618802947584:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 115us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.633240:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 123 00000100:00100000:2.0:1789683411.635863:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.635971:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802947712 00000100:00100000:3.0:1789683411.635984:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802947712 00000100:00100000:3.0:1789683411.636063:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:3.0:1789683411.636073:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:10536:x1876618802947712:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683411.636091:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683411.636110:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01a9 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.636144:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a2 expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.636155:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683411.636159:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683411.636164:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.636210:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a2 expref: 11 pid: 6676 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.636226:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a2 expref: 11 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.636240:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6677:1876618815545216:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683411.636322:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe627c5480 going to sleep for 11 seconds 00000100:00100000:1.0:1789683411.639859:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.640346:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802947840 00000100:00100000:2.0:1789683411.640356:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802947840 00010000:00010000:2.0:1789683411.640416:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a2 expref: 12 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683411.640468:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:2.0:1789683411.640479:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:2353:x1876618802947840:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683411.640507:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683411.640530:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a2 expref: 12 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.640544:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a2 expref: 12 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.640567:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683411.640571:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683411.640579:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.640589:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.640625:0:5815:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 12 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683411.640639:0:5815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7bd9ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1876618815545344:192.168.203.60@tcp:105: 00000100:00100000:2.0:1789683411.640757:0:5815:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952600 going to sleep for 11 seconds 00010000:00010000:3.0:1789683411.641293:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff22c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a2 expref: 12 pid: 6676 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.641312:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760b0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6677:1876618815545216:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683411.641334:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 11 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.641346:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9600, rc 0) 00000100:00100000:3.0:1789683411.641404:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:10536:x1876618802947712:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 5331us (5549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.641413:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:1.0:1789683411.646622:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.647005:0:5815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7bd9ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5815:1876618815545344:192.168.203.60@tcp:105: 00010000:00010000:2.0:1789683411.647055:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683411.647155:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2353:x1876618802947840:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 6678us (7304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.647164:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802947968 00000100:00100000:0.0:1789683411.647172:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802947968 00000100:00100000:2.0:1789683411.647173:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00002000:00100000:0.0:1789683411.647224:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8dbe53f65500 x1876618802947968/t0(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:467/0 lens 504/0 e 0 to 0 dl 1789683422 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683411.647234:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe53f65500 with x1876618802947968 ext(0->12) 00002000:00010000:0.0:1789683411.647239:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe53f65500 00000100:00100000:0.0:1789683411.647269:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1789683411.647278:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2352:x1876618802947968:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789683411.647818:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:2352:x1876618802947968:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 539us (1203us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789683411.647826:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00002000:00100000:0.0:1789683411.647832:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8dbe53f65500 x1876618802947968/t4294967308(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:467/0 lens 504/448 e 0 to 0 dl 1789683422 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683411.647841:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe53f65500 with x1876618802947968 ext(0->12) 00002000:00010000:0.0:1789683411.647845:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe53f65500 00000100:00100000:2.0:1789683411.650918:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683411.651077:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802948096 00000100:00100000:1.0:1789683411.651088:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802948096 00000100:00100000:1.0:1789683411.651149:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:1.0:1789683411.651161:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:10536:x1876618802948096:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789683411.689700:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1789683411.689741:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789683411.689766:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dbe52f2bb40 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789683411.689771:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe60812300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe52f2b240 00000020:00080000:3.0:1789683411.689789:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe60812200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe7f0bc400 00000004:00080000:3.0:1789683411.689810:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789683411.689864:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dbe5309ff00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789683411.689867:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe76a1eb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe5309f780 00000020:00080000:3.0:1789683411.689870:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe76a1e400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe760c2c00 00000004:00080000:3.0:1789683411.689887:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:3.0:1789683411.689917:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:3.0:1789683411.690095:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815545472:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789683411.690171:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683411.690227:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815545472 00000100:00100000:3.0:1789683411.690234:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815545472 00000100:00100000:3.0:1789683411.690287:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683411.690297:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815545472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789683411.690325:0:6676:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1789683411.690353:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.690378:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0108 expref: 11 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.690388:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789683411.690393:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683411.690397:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.690427:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0108 expref: 11 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.690450:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0108 expref: 11 pid: 8465 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.690463:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe760b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6676:1876618815545600:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683411.690529:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe627c5480 going to sleep for 11 seconds 00000020:00080000:3.0:1789683411.691134:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1789683411.691354:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789683411.692791:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683411.692811:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815545728:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789683411.692877:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683411.692924:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815545728 00000100:00100000:0.0:1789683411.692931:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815545728 00000100:00100000:0.0:1789683411.692996:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789683411.693006:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815545728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1789683411.693034:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1789683411.693071:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aac66d2, atime: 0x6aac66d3, ctime: 0x6aac66d2, blocks: 0xb 00010000:00010000:0.0:1789683411.693079:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693113:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=345s v=(0 0) 00010000:00010000:0.0:1789683411.693118:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683411.693125:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693143:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693153:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693161:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693179:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789683411.693780:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76129f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815545728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 772us (900us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789683411.693789:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789683411.693821:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683411.693827:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693837:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fa00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683411.693842:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693863:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693883:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693890:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff241 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.693910:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683411.693912:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683411.693914:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683411.693941:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789683411.693947:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:0.0:1789683411.693964:0:3303:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe76d01180, transno 4294967301 00000004:00080000:0.0:1789683411.693973:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:0.0:1789683411.694003:0:3303:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8dbe76129180 x1876618815545728/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789683427 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789683411.694015:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe76129180/2, rc 0, transno 4294967304 00000100:00100000:0.0:1789683411.694020:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815545728:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789683411.694899:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6676:1876618815545600:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683411.694918:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683411.696279:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:10536:x1876618802948096:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 45110us (45359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.696292:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 124 00000100:00100000:2.0:1789683411.697103:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.697228:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802948224 00000100:00100000:3.0:1789683411.697238:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802948224 00010000:00010000:3.0:1789683411.697274:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0108 expref: 12 pid: 8465 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.697314:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:3.0:1789683411.697324:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:2353:x1876618802948224:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683411.697338:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683411.697344:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0108 expref: 12 pid: 8465 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.697356:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0108 expref: 12 pid: 8465 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.697378:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f4c7dda3/0x59bee33f93feffc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0108 expref: 12 pid: 8465 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.697417:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683411.697422:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683411.697428:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.697437:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.697465:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683411.697500:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:2353:x1876618802948224:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 177us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.697507:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00010000:00010000:0.0:1789683411.699336:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.699371:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.699383:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.699391:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.699470:0:6676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789683411.700066:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815545472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9767us (9892us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789683411.700075:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1789683411.701871:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe760b0a80/2, rc 0, transno 4294967309 00000100:00100000:0.0:1789683411.701894:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe760b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815545472:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1789683411.703925:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683411.703940:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.704036:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683411.704043:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.704055:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.704081:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.704089:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff23a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.704121:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683411.704140:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683411.704142:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683411.704432:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.704571:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802948352 00000100:00100000:3.0:1789683411.704581:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802948352 00000100:00100000:3.0:1789683411.704712:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1789683411.704723:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:2353:x1876618802948352:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789683411.726656:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:2353:x1876618802948352:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 21923us (22218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683411.726668:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000001:00080000:0.0:1789683411.728876:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1789683411.728892:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1789683411.729626:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683411.729830:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802948608 00000100:00100000:1.0:1789683411.729842:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802948608 00000100:00100000:1.0:1789683411.729909:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 125 00000100:00100000:1.0:1789683411.729920:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:10536:x1876618802948608:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789683411.729998:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683411.730025:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f019b expref: 15 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.730045:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:1.0:1789683411.730051:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683411.730080:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.730094:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.730104:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683411.730342:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008da95172 reply state 00000000af8e5799 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683411.730351:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683411.730501:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:10536:x1876618802948608:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 582us (880us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1789683411.730524:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 125 00010000:00010000:2.0:1789683411.732443:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.732458:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.732464:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.732470:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683411.732474:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.732481:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.732496:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:2.0:1789683411.732499:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683411.732503:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.732510:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6e00/0x59bee33f93ff248 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683411.733253:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.733330:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802948736 00000100:00100000:3.0:1789683411.733339:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802948736 00000100:00100000:3.0:1789683411.733393:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1789683411.733403:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802948736:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789683411.733637:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789683411.733641:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789683411 00002000:00010000:3.0:1789683411.733643:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789683411 00002000:00010000:3.0:1789683411.733719:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789683412 -> 1789683411 00002000:00010000:3.0:1789683411.733723:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789683411.733796:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802948736:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 395us (548us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789683411.733804:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:3.0:1789683411.737387:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.737643:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802948992 00000100:00100000:0.0:1789683411.737655:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802948992 00000100:00100000:1.0:1789683411.738077:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:1.0:1789683411.738089:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:10536:x1876618802948992:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789683411.738179:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.738207:0:9827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f018d expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.738218:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.738260:0:9827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f018d expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.738275:0:9827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f018d expref: 15 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683411.738291:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815545856:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683411.738514:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683411.743630:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a31c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815545856:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683411.743669:0:9827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.744093:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.744281:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802949120 00000100:00100000:2.0:1789683411.744291:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802949120 00010000:00010000:2.0:1789683411.744353:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f018d expref: 16 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683411.744396:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:2.0:1789683411.744407:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:2353:x1876618802949120:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683411.744423:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683411.744431:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f018d expref: 16 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.744443:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f018d expref: 16 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.744464:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff209 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f018d expref: 16 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.744482:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:2.0:1789683411.744488:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.744498:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.744508:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.744538:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683411.744603:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:2353:x1876618802949120:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 197us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.744611:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00010000:00010000:3.0:1789683411.745018:0:9827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.745027:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.745058:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.745064:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.745070:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.745076:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683411.745080:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.745086:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.745096:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:3.0:1789683411.745099:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789683411.745103:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.745121:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff24f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.745182:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10536:x1876618802948992:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 7094us (7806us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789683411.745190:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 126 00000100:00100000:3.0:1789683411.747438:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683411.747530:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802949248 00000100:00100000:0.0:1789683411.747541:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802949248 00000100:00100000:0.0:1789683411.747599:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1789683411.747610:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802949248:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789683411.747664:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.747724:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.747733:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683411.747738:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683411.747742:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.747776:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 7 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.747790:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 7 pid: 6677 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683411.747804:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76128a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1876618815545984:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683411.747876:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7d6b5c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683411.750005:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76128a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1876618815545984:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683411.750031:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.752631:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.753564:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802949376 00000100:00100000:2.0:1789683411.753575:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802949376 00010000:00010000:2.0:1789683411.753618:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 8 pid: 6677 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683411.753756:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:2.0:1789683411.753767:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c163800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802949376:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683411.753783:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683411.753805:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 8 pid: 6677 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.753819:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 8 pid: 6677 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.753842:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff233 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01a9 expref: 8 pid: 6677 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.753859:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683411.753863:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683411.753869:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.753878:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.753913:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683411.753979:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c163800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802949376:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 213us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.754009:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00010000:00010000:1.0:1789683411.754324:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.754347:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.754372:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.754381:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.754390:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.754397:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683411.754401:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.754409:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.754423:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.754430:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048c1e3b7/0x59bee33f93ff256 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683411.754958:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c163480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802949248:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 7348us (7524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683411.754967:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:3.0:1789683411.757524:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.757647:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802949632 00000100:00100000:2.0:1789683411.757658:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802949632 00000100:00100000:2.0:1789683411.757802:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 127 00000100:00100000:2.0:1789683411.757813:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10536:x1876618802949632:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789683411.757888:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.757906:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.757917:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.758124:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.758136:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0194 expref: 15 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.758144:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.758191:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0194 expref: 15 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.758215:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0194 expref: 15 pid: 9827 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683411.758253:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c119c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815546112:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683411.758347:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683411.760863:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.760956:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802949760 00000100:00100000:3.0:1789683411.760965:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802949760 00010000:00010000:3.0:1789683411.761012:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0194 expref: 16 pid: 9827 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.761054:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:3.0:1789683411.761063:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:2353:x1876618802949760:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683411.761079:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683411.761085:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0194 expref: 16 pid: 9827 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.761098:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0194 expref: 16 pid: 9827 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.761119:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:3.0:1789683411.761124:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.761151:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.761159:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.761178:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683411.761243:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:2353:x1876618802949760:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 181us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.761251:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00010000:00010000:2.0:1789683411.762400:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff217 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0194 expref: 15 pid: 9827 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683411.762421:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c119c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815546112:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683411.762446:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.762581:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.762589:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683411.763006:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789683411.763146:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789683411.763189:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789683411.763271:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1876618815546240:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789683411.763394:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683411.763466:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683411.763602:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815546240 00000100:00100000:0.0:1789683411.763609:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815546240 00000100:00100000:0.0:1789683411.763738:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683411.763748:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5829:x1876618815546240:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789683411.763827:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5829:x1876618815546240:12345-0@lo:1000:mdt00_000.0 Request processed in 81us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683411.763848:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683411.763910:0:5829:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:1.0:1789683411.763914:0:5829:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:1.0:1789683411.763929:0:5829:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe760b0a80, transno 4294967309 00000100:00100000:1.0:1789683411.763947:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1876618815546240:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1789683411.764389:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789683411.764444:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1876618815546368:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789683411.764475:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683411.764997:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe46ef10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683411.765024:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815546368 00000100:00100000:3.0:1789683411.765030:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815546368 00000100:00100000:3.0:1789683411.765058:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683411.765065:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1876618815546368:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789683411.765265:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5829:x1876618815546368:12345-0@lo:1000:mdt00_000.0 Request processed in 199us (787us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789683411.765272:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683411.765421:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1876618815546368:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1789683411.765451:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765473:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765481:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765486:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683411.765601:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765611:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765626:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9200) 00010000:00010000:1.0:1789683411.765629:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683411.765634:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765640:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff264 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765819:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765827:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765833:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765838:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683411.765847:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765854:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765862:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:1.0:1789683411.765865:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683411.765872:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93ff1ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0178 expref: 18 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765883:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93ff1ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0178 expref: 18 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765892:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93ff1ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0178 expref: 18 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.765918:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93ff1ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0178 expref: 18 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683411.765929:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815546496:192.168.203.60@tcp:105: 00000100:00100000:1.0:1789683411.766031:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe46ef10c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683411.770857:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.772326:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a30e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815546496:192.168.203.60@tcp:105: 00010000:00010000:2.0:1789683411.772356:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772367:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff1a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772398:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.772405:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802949888 00010000:00010000:2.0:1789683411.772410:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.772411:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802949888 00010000:00010000:2.0:1789683411.772421:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772430:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772453:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772459:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772465:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683411.772469:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772476:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772486:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683411.772490:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683411.772494:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772500:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff26b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772512:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772518:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772523:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772528:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8da00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683411.772537:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772544:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772552:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683411.772555:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683411.772558:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.772564:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff25d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.772599:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:3.0:1789683411.772612:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10535:x1876618802949888:12345-192.168.203.60@tcp:49:lfs.0 00000100:00100000:2.0:1789683411.772786:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c160e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:10536:x1876618802949632:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 14974us (15270us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1789683411.772794:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 127 00000020:00080000:2.0:1789683411.772799:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789683411.772880:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683411.772884:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683411.773841:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1789683411.773852:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789683411.775049:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:10535:x1876618802949888:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 2432us (4195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.775061:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:0.0:1789683411.776160:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.776469:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802950144 00000100:00100000:3.0:1789683411.776479:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802950144 00000100:00100000:1.0:1789683411.777042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:1.0:1789683411.777059:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe708a1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:10536:x1876618802950144:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789683411.778028:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789683411.778137:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1789683411.778190:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.778213:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.778225:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.778235:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.778242:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.778248:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683411.778263:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683411.778404:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683411.778779:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.778787:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683411.778791:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.778800:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.778813:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8dbe46df9800) 00010000:00010000:0.0:1789683411.778816:0:7626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789683411.778822:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.778828:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff272 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683411.778848:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683411.778850:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683411.778852:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683411.779101:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe708a1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:10536:x1876618802950144:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 2042us (2941us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1789683411.779112:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000020:00080000:1.0:1789683411.779118:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789683411.780055:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.780126:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802950400 00000100:00100000:3.0:1789683411.780147:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802950400 00000100:00100000:3.0:1789683411.780237:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:3.0:1789683411.780248:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:10535:x1876618802950400:12345-192.168.203.60@tcp:58:lfs.0 00000040:00080000:3.0:1789683411.780490:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1789683411.780616:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c119c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:10535:x1876618802950400:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 370us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.780624:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 128 00000100:00100000:0.0:1789683411.807199:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.807327:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802950528 00000100:00100000:3.0:1789683411.807340:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802950528 00000100:00100000:3.0:1789683411.807438:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 129 00000100:00100000:3.0:1789683411.807451:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:10538:x1876618802950528:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683411.807478:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683411.807516:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff279 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01b0 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.807584:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.807598:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.807609:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.807624:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.807631:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.807669:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.807933:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.807956:0:9827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0171 expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.807964:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.808008:0:9827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0171 expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.808022:0:9827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0171 expref: 21 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.808036:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c161c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815546624:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683411.810022:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe627c5480 going to sleep for 11 seconds 00000100:00100000:3.0:1789683411.813868:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c161c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815546624:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683411.813903:0:9827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683411.814387:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683411.814663:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802950784 00000100:00100000:2.0:1789683411.814688:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802950784 00000100:00100000:2.0:1789683411.814755:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1789683411.814765:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:5585:x1876618802950784:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789683411.815016:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:5585:x1876618802950784:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 251us (629us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789683411.815024:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:1.0:1789683411.819618:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683411.819715:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802950912 00000100:00100000:3.0:1789683411.819736:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802950912 00010000:00010000:3.0:1789683411.819776:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0171 expref: 23 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683411.819843:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:3.0:1789683411.819854:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:2353:x1876618802950912:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683411.819868:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683411.819875:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0171 expref: 23 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.819888:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0171 expref: 23 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.819910:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff199 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0171 expref: 23 pid: 5829 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.819927:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:3.0:1789683411.819933:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.819943:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.819951:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683411.819993:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683411.820052:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:2353:x1876618802950912:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 199us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683411.820060:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00010000:00010000:2.0:1789683411.820289:0:9827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820300:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683411.820358:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1789683411.820363:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683411.820387:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820399:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820409:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820416:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820422:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820428:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683411.820432:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820441:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820450:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:2.0:1789683411.820453:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683411.820457:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820463:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820487:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820508:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820514:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820519:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683411.820522:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820528:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820536:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8dbe5931ed00) 00010000:00010000:2.0:1789683411.820539:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683411.820542:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820547:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820585:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff279 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01b0 expref: 22 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820599:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01b0 expref: 21 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683411.820618:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683411.820620:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683411.820623:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9200, rc 0) 00000100:00100000:2.0:1789683411.820654:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10538:x1876618802950528:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 13206us (13467us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683411.820661:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 129 00010000:00010000:0.0:1789683412.512743:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683412.647433:0:12056:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683412.647443:0:12056:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683412.647511:0:12056:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789683412.647518:0:12056:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1789683412.833059:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683412.833069:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683412.833130:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789683412.833139:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683412.833258:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7612ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815546752:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789683412.833353:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7d6b5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683412.839456:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7612ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815546752:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789683412.840882:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683412.841808:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802951040 00000100:00100000:2.0:1789683412.841818:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802951040 00000100:00100000:2.0:1789683412.841884:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:2.0:1789683412.841894:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10551:x1876618802951040:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789683412.841927:0:5829:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789683412.844061:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10551:x1876618802951040:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 158us (1174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683412.844075:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 130 00000100:00100000:1.0:1789683412.845857:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683412.846353:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802951296 00000100:00100000:3.0:1789683412.846377:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802951296 00000100:00100000:3.0:1789683412.846479:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:3.0:1789683412.846491:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:10551:x1876618802951296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683412.846512:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683412.846534:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff295 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01b7 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683412.846646:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff29c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683412.846662:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683412.846721:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff29c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683412.846735:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789683412.846873:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff295 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01b7 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683412.846892:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff29c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01b7 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683412.846901:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:3.0:1789683412.846904:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683412.846907:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8400, rc 0) 00000100:00100000:3.0:1789683412.846975:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:10551:x1876618802951296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 487us (1124us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1789683412.846992:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 131 00000100:00100000:3.0:1789683412.855419:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683412.855467:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683412.855804:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802951424 00000100:00100000:2.0:1789683412.855814:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802951424 00000100:00100000:2.0:1789683412.855872:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1789683412.855883:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c163800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:2352:x1876618802951424:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683412.855898:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683412.855921:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff29c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01b7 expref: 23 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683412.855950:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683412.855956:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683412.856040:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c163800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:2352:x1876618802951424:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 158us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683412.856734:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1789683412.857138:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802951680 00000100:00100000:0.0:1789683412.857146:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802951680 00000100:00100000:0.0:1789683412.857198:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 132 00000100:00100000:0.0:1789683412.857207:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:10551:x1876618802951680:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789683412.857278:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683412.857293:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683412.857303:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683412.857909:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683412.857918:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683412.857932:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683412.858259:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683412.858264:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683412.858272:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683412.858284:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:0.0:1789683412.858287:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789683412.858291:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683412.858297:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff2aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683412.858468:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c161c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:10551:x1876618802951680:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 1259us (2997us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789683412.858477:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 132 00000040:00080000:2.0:1789683412.859870:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683412.859877:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683412.861695:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789683412.861713:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789683412.863634:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683412.863764:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802951936 00000100:00100000:1.0:1789683412.863773:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802951936 00000100:00100000:1.0:1789683412.863826:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:1.0:1789683412.863837:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:10551:x1876618802951936:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789683412.864101:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:10551:x1876618802951936:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 265us (473us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1789683412.864127:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00010000:00010000:2.0:1789683413.536039:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789683414.372927:0:12107:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789683414.372936:0:12107:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789683414.373001:0:12107:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789683414.373007:0:12107:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683414.500013:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815546880:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683414.500082:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683414.500156:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815546880 00000100:00100000:1.0:1789683414.500164:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815546880 00000100:00100000:1.0:1789683414.500216:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789683414.500224:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815546880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683414.500259:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683414.500300:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815546880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683414.500316:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:1.0:1789683414.500336:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683414.500371:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815546880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789683414.562291:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683414.577240:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683414.577316:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802952192 00000100:00100000:2.0:1789683414.577326:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802952192 00000100:00100000:2.0:1789683414.577425:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00100000:2.0:1789683414.577435:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:10571:x1876618802952192:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683414.577459:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683414.577480:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff2b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683414.577587:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff2b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683414.577603:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683414.577614:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff2b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683414.577626:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789683414.577779:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff2b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01be expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683414.577796:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff2b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01be expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683414.577817:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:2.0:1789683414.577820:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789683414.577824:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d000, rc 0) 00000100:00100000:2.0:1789683414.577888:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:10571:x1876618802952192:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 453us (654us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1789683414.577895:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 133 00000100:00080000:1.0:1789683414.578171:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683414.583803:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683414.583884:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802952320 00000100:00100000:3.0:1789683414.583894:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802952320 00000100:00100000:3.0:1789683414.584048:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:3.0:1789683414.584059:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:10571:x1876618802952320:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:3.0:1789683414.584130:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.584147:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.584159:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.584186:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.584193:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.584200:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.584207:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683414.584211:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.584232:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.584245:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:3.0:1789683414.584249:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683414.584255:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.584261:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9e00/0x59bee33f93ff2c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683414.584335:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:10571:x1876618802952320:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 278us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683414.584342:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 134 00000100:00100000:0.0:1789683414.681731:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683414.681874:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802952448 00000100:00100000:3.0:1789683414.681884:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802952448 00000100:00100000:3.0:1789683414.682246:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1789683414.682257:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802952448:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1789683414.682275:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683414.682295:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ff2cd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01c5 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683414.682321:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aac66d3, atime: 0x6aac66d3, ctime: 0x6aac66d3, blocks: 0xb 00010000:00010000:3.0:1789683414.682341:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:3.0:1789683414.682345:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683414.682354:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ff2cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01c5 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.682393:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ff2cd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01c5 expref: 7 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683414.682407:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9e00, rc 0) 00000100:00100000:3.0:1789683414.682474:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2354:x1876618802952448:12345-192.168.203.60@tcp:101:cat.0 Request processed in 219us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683414.682481:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00080000:1.0:1789683414.685125:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683414.694651:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683414.694860:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802952576 00000100:00100000:3.0:1789683414.694870:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802952576 00002000:00100000:3.0:1789683414.694917:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8dbe53098380 x1876618802952576/t0(0) o3->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:470/0 lens 488/0 e 0 to 0 dl 1789683425 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683414.694939:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe53098380 with x1876618802952576 ext(0->4095) 00002000:00010000:3.0:1789683414.694944:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe53098380 00000100:00100000:3.0:1789683414.694985:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1789683414.694996:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802952576:12345-192.168.203.60@tcp:3:cat.0 00000100:00100000:3.0:1789683414.695886:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802952576:12345-192.168.203.60@tcp:3:cat.0 Request processed in 888us (1240us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789683414.695897:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00002000:00100000:3.0:1789683414.695907:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8dbe53098380 x1876618802952576/t0(0) o3->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:470/0 lens 488/4536 e 0 to 0 dl 1789683425 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683414.695927:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe53098380 with x1876618802952576 ext(0->4095) 00002000:00010000:3.0:1789683414.695932:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe53098380 00010000:00010000:0.0:1789683415.584826:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683416.245207:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683416.245257:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683416.245297:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683416.245324:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802953216 00000100:00100000:0.0:1789683416.245333:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802953216 00000100:00100000:0.0:1789683416.245400:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:0.0:1789683416.245410:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802953216:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683416.245477:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76128a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2352:x1876618802953216:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 70us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683416.245484:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:0.0:1789683416.245524:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683416.245545:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802952832 00000100:00100000:0.0:1789683416.245549:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802952832 00000100:00100000:0.0:1789683416.245571:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:0.0:1789683416.245578:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:2352:x1876618802952832:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683416.245604:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:2352:x1876618802952832:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 27us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683416.245610:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:0.0:1789683416.245710:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683416.245975:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802952704 00000100:00100000:1.0:1789683416.245981:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802952704 00000100:00100000:1.0:1789683416.246013:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 299 00000100:00100000:1.0:1789683416.246020:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802952704:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683416.246048:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2352:x1876618802952704:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683416.246055:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 299 00000100:00080000:1.0:1789683416.246093:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683416.246115:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802952960 00000100:00100000:1.0:1789683416.246119:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802952960 00000100:00100000:1.0:1789683416.246148:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802953088 00000100:00100000:1.0:1789683416.246151:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802953088 00000100:00100000:1.0:1789683416.246172:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:1.0:1789683416.246178:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2352:x1876618802952960:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683416.246207:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2352:x1876618802952960:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683416.246214:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:1.0:1789683416.246225:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:1.0:1789683416.246231:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802953088:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683416.246253:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802953088:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 23us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683416.246257:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00080000:1.0:1789683416.246277:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683416.246280:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789683416.544003:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350175327733ns, next at 351175325576ns, rc = 0 00000100:00100000:1.0:1789683416.544183:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815547264:0@lo:400:kworker.0 00000100:00100000:1.0:1789683416.544265:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683416.544322:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815547776:0@lo:400:kworker.0 00000100:00100000:1.0:1789683416.544349:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683416.544379:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683416.544385:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815547392:0@lo:400:kworker.0 00000100:00100000:1.0:1789683416.544408:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683416.544442:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815547776 00000100:00100000:1.0:1789683416.544449:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815547776 00000100:00100000:1.0:1789683416.544510:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789683416.544520:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876618815547776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683416.544584:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876618815547776:12345-0@lo:400:kworker.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683416.544591:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789683416.544613:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815547264 00000100:00100000:1.0:1789683416.544617:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815547264 00000100:00100000:1.0:1789683416.544649:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815547392 00000100:00100000:1.0:1789683416.544652:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815547392 00000100:00100000:1.0:1789683416.544693:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1789683416.544825:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815547136:0@lo:400:kworker.0 00000100:00100000:2.0:1789683416.544858:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683416.544884:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815547648:0@lo:400:kworker.0 00000100:00100000:2.0:1789683416.544904:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683416.544923:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789683416.544928:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c11a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683416.544959:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683416.544976:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815547520:0@lo:400:kworker.0 00000100:00100000:2.0:1789683416.544994:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683416.545251:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815547648 00000100:00100000:3.0:1789683416.545263:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815547648 00000100:00100000:3.0:1789683416.545287:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789683416.545293:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815547392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683416.545332:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815547392:12345-0@lo:400:kworker.0 Request processed in 39us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683416.545339:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1789683416.545352:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789683416.545358:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815547648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683416.545402:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815547264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683416.545433:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815547264:12345-0@lo:400:kworker.0 Request processed in 734us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683416.545439:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1789683416.545464:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683416.545469:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683416.545476:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815547520 00000100:00100000:1.0:1789683416.545479:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815547520 00000100:00100000:2.0:1789683416.545521:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815547136 00000100:00100000:2.0:1789683416.545524:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815547136 00000100:00100000:3.0:1789683416.549519:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815547648:12345-0@lo:400:kworker.0 Request processed in 4151us (4603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683416.549609:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789683416.549874:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789683416.549888:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815547520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683416.549970:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815547520:12345-0@lo:400:kworker.0 Request processed in 87us (4974us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683416.549976:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1789683416.550009:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683416.550057:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815547392:0@lo:400:kworker.0 00000100:00100000:1.0:1789683416.550070:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815547264:0@lo:400:kworker.0 00000100:00100000:1.0:1789683416.550082:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815547776:0@lo:400:kworker.0 00000100:00100000:2.0:1789683416.558304:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789683416.558360:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815547520:0@lo:400:kworker.0 00000100:00100000:2.0:1789683416.558375:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815547648:0@lo:400:kworker.0 00000100:00100000:2.0:1789683416.558409:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815547008 00000100:00100000:2.0:1789683416.558417:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815547008 00000100:00100000:2.0:1789683416.558480:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789683416.558496:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815547008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683416.560601:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683416.561353:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815547008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2852us (16396us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683416.561364:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789683416.561469:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c11a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815547008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683416.572211:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815547136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683416.572355:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815547136:12345-0@lo:400:kworker.0 Request processed in 14038us (27494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683416.572366:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789683416.574931:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815547136:0@lo:400:kworker.0 00010000:00010000:2.0:1789683416.607966:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683416.679638:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1789683417.142479:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1789683417.142499:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789683417.216070:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:3.0:1789683417.216082:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:3.0:1789683417.216093:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dbe46ef1300 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1789683417.216098:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbd447f9000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe46ef1240 00000020:00080000:3.0:1789683417.216101:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbd447f9800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe76895c00 00000004:00080000:3.0:1789683417.216128:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1789683417.216160:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:0.0:1789683417.216325:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000001:00080000:3.0:1789683417.217033:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1789683417.217052:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:1.0:1789683417.217157:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c11a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815547904:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789683417.217215:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683417.218067:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815547904 00000100:00100000:3.0:1789683417.218076:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815547904 00000100:00100000:3.0:1789683417.218133:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683417.218150:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815547904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789683417.218773:0:8465:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789683417.218779:0:8465:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789683411 -> 1789683411 00002000:00010000:3.0:1789683417.218781:0:8465:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789683411 -> 1789683411 00002000:00010000:3.0:1789683417.218783:0:8465:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789683411 -> 1789683411 00002000:00010000:3.0:1789683417.218786:0:8465:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789683417.225639:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815547904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 7482us (8414us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789683417.225652:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789683417.227136:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1789683417.227146:0:3303:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1789683417.227170:0:3303:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8dbe7c11a680 x1876618815547904/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789683433 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1789683417.227182:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe7c11a680/2, rc 0, transno 4294967312 00000100:00100000:0.0:1789683417.227187:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c11a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815547904:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789683417.631864:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683418.656802:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789683419.045969:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683419.045977:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683419.046016:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789683419.046024:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683419.615960:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789683419.615985:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815548032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683419.616057:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683419.616480:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815548032 00000100:00100000:0.0:1789683419.616489:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815548032 00000100:00100000:0.0:1789683419.616556:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789683419.616566:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815548032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683419.616600:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683419.616650:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815548032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683419.616657:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789683419.616716:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1789683419.616721:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe76129180, transno 4294967304 00000100:00100000:0.0:1789683419.616737:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815548032:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789683419.617180:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683419.679919:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683419.799361:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683419.801021:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802953344 00000100:00100000:1.0:1789683419.801035:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802953344 00000100:00100000:1.0:1789683419.801173:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00100000:1.0:1789683419.801185:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:10224:x1876618802953344:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789683419.801308:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:10224:x1876618802953344:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 126us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683419.801315:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 135 00000100:00080000:2.0:1789683419.804768:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683419.815074:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683419.815403:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802953600 00000100:00100000:0.0:1789683419.815414:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802953600 00000100:00100000:0.0:1789683419.815473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:0.0:1789683419.815483:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:10224:x1876618802953600:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789683419.816374:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:10224:x1876618802953600:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 887us (1306us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1789683419.816395:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00010000:00010000:0.0:1789683420.703837:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683421.352497:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683421.352611:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683421.352653:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683421.352714:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802954112 00000100:00100000:1.0:1789683421.352725:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802954112 00000100:00100000:1.0:1789683421.352788:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1789683421.352799:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802954112:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683421.356101:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802953728 00000100:00100000:2.0:1789683421.356115:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802953728 00000100:00100000:2.0:1789683421.356192:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 301 00000100:00100000:2.0:1789683421.356203:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802953728:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683421.356270:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802953728:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 70us (3660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683421.356278:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 301 00000100:00080000:2.0:1789683421.356312:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683421.357464:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683421.357548:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683421.357598:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802954112:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 75us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683421.357611:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1789683421.357634:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802953984 00000100:00100000:1.0:1789683421.357640:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802953984 00000100:00100000:1.0:1789683421.357697:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:1.0:1789683421.357706:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802953984:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683421.357764:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c161180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802953984:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 59us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683421.357771:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00080000:2.0:1789683421.357950:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683421.362124:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802953856 00000100:00100000:0.0:1789683421.362378:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802953856 00000100:00100000:0.0:1789683421.362495:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802954240 00000100:00100000:0.0:1789683421.362499:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802954240 00000100:00100000:3.0:1789683421.362542:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:3.0:1789683421.362554:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:2352:x1876618802953856:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683421.362634:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:2352:x1876618802953856:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 83us (10149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683421.362640:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00080000:2.0:1789683421.371927:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683421.374388:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:0.0:1789683421.374404:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802954240:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683421.374540:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c161f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802954240:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 139us (16990us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683421.374560:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:3.0:1789683421.666003:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683421.666067:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815548160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683421.666134:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683421.666947:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815548416:0@lo:400:kworker.0 00000100:00100000:1.0:1789683421.666966:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815548288:0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.666986:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683421.667008:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683421.667023:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683421.667031:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815548800:0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.667054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683421.667057:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815548160 00000100:00100000:1.0:1789683421.667065:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815548160 00000100:00100000:0.0:1789683421.667084:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815548544:0@lo:400:kworker.0 00000100:00100000:1.0:1789683421.667118:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789683421.667127:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815548160:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683421.667201:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683421.667220:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683421.667226:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815548672:0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.667249:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683421.667275:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815548416 00000100:00100000:0.0:1789683421.667279:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815548416 00000100:00100000:0.0:1789683421.667320:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815548800 00000100:00100000:0.0:1789683421.667324:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815548800 00000100:00100000:0.0:1789683421.667347:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815548544 00000100:00100000:0.0:1789683421.667350:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815548544 00000100:00100000:0.0:1789683421.667366:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789683421.667372:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815548416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.667421:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815548416:12345-0@lo:400:kworker.0 Request processed in 48us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683421.667428:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1789683421.667445:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789683421.667452:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815548800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.667479:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815548800:12345-0@lo:400:kworker.0 Request processed in 28us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683421.667495:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1789683421.667507:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789683421.667513:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815548544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.667546:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815548544:12345-0@lo:400:kworker.0 Request processed in 33us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683421.667551:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1789683421.667571:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815548672 00000100:00100000:0.0:1789683421.667574:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815548672 00000100:00100000:0.0:1789683421.667600:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683421.667606:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815548672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.667923:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815548672:12345-0@lo:400:kworker.0 Request processed in 316us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683421.667930:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683421.667980:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815548672:0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.667990:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815548544:0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.668019:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815548800:0@lo:400:kworker.0 00000100:00100000:0.0:1789683421.668028:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815548416:0@lo:400:kworker.0 00002000:00000024:1.0:1789683421.668151:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683421.668201:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c161500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815548160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1074us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683421.668209:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1789683421.668231:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683421.668236:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683421.668238:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683421.668393:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c162680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815548160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683421.669267:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815548288 00000100:00100000:3.0:1789683421.669275:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815548288 00000100:00100000:3.0:1789683421.669454:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1789683421.669464:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815548288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683421.669536:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815548288:12345-0@lo:400:kworker.0 Request processed in 74us (2529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683421.669543:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789683421.669552:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76129180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815548288:0@lo:400:kworker.0 00010000:00010000:0.0:1789683421.732207:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789683422.074140:0:12307:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:17:00 (1789683420) 00000001:00080000:0.0:1789683422.226103:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1789683422.264659:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1789683422.264701:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:2.0:1789683422.265038:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1789683422.265062:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:1.0:1789683422.752514:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683423.759172:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683423.759312:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802954496 00000100:00100000:0.0:1789683423.759323:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802954496 00000100:00100000:0.0:1789683423.759408:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00100000:0.0:1789683423.759421:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:11282:x1876618802954496:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00000100:00080000:1.0:1789683423.759431:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789683423.759461:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683423.759603:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff2d4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01cc expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.759776:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.759792:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.760291:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.760346:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.760354:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.760364:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.761844:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff2e9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.761862:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.761872:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683423.761885:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789683423.762063:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762072:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762080:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762087:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683423.762091:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762100:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762113:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dbe60aa2100) 00010000:00010000:0.0:1789683423.762116:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683423.762121:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762128:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff2db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762140:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762145:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762150:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762155:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683423.762165:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762172:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762180:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683423.762183:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683423.762186:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762192:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff2e2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762559:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff2d4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01cc expref: 16 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762575:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01cc expref: 15 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683423.762583:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:0.0:1789683423.762585:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683423.762588:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ee00, rc 0) 00000100:00100000:0.0:1789683423.762665:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:11282:x1876618802954496:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3247us (3503us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789683423.762723:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 136 00000100:00100000:3.0:1789683423.775059:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683423.775176:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802954624 00000100:00100000:0.0:1789683423.775187:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802954624 00000100:00100000:0.0:1789683423.775256:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 137 00000100:00100000:0.0:1789683423.775267:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:11282:x1876618802954624:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789683423.775393:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c160a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:11282:x1876618802954624:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 128us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683423.775402:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 137 00010000:00010000:0.0:1789683423.775862:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683423.782269:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683423.782348:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802954752 00000100:00100000:3.0:1789683423.782358:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802954752 00000100:00100000:3.0:1789683423.782420:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1789683423.782429:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:2355:x1876618802954752:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683423.782444:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683423.782465:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff2e9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01cc expref: 15 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683423.782488:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:3.0:1789683423.782493:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683423.782545:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:2355:x1876618802954752:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 118us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683423.782553:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000040:00080000:1.0:1789683424.160862:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683424.160870:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683424.161368:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789683424.161377:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789683424.735945:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789683424.735968:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815548928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683424.736047:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683424.736234:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815548928 00000100:00100000:1.0:1789683424.736243:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815548928 00000100:00100000:1.0:1789683424.736305:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789683424.736316:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815548928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683424.736351:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683424.736401:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c162a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815548928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683424.736407:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789683424.736451:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815548928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683424.736499:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683424.800059:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683425.823927:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683425.849422:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683425.849554:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802954880 00000100:00100000:3.0:1789683425.849564:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802954880 00000100:00100000:3.0:1789683425.849641:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00100000:3.0:1789683425.849652:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:11324:x1876618802954880:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683425.849691:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683425.849711:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff2f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01d3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.849777:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.849806:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.849817:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.849832:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.849838:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.849844:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850054:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850062:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850069:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850075:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683425.850079:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850086:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850098:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931e900) 00010000:00010000:3.0:1789683425.850106:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683425.850112:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850118:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff2fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850131:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850137:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850142:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850146:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683425.850149:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850154:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850161:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dbe5931e300) 00010000:00010000:3.0:1789683425.850163:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683425.850165:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850170:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff305 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850200:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff2f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01d3 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850219:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931e900) 00010000:00010000:3.0:1789683425.850221:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683425.850225:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff2f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01d3 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683425.850235:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8600, rc 0) 00000100:00100000:3.0:1789683425.850293:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:11324:x1876618802954880:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 644us (894us total) trans 0 rc 301/301 00000100:00100000:3.0:1789683425.850300:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 138 00000100:00080000:1.0:1789683425.850768:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683425.864499:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683425.864584:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802955136 00000100:00100000:0.0:1789683425.864594:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802955136 00000100:00100000:0.0:1789683425.864652:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 139 00000100:00100000:0.0:1789683425.864667:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:11324:x1876618802955136:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:0.0:1789683425.864742:0:6698:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683425.864768:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93fec83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0013 expref: 14 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.864786:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5931e900) 00010000:00010000:0.0:1789683425.864795:0:6698:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683425.865023:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.865037:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.865047:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.865059:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.865066:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.865084:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683425.865979:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789683425.865993:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.866002:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.866008:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.866014:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fc00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683425.866019:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.866027:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.866038:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683425.866041:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683425.866045:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.866051:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff30c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683425.866070:0:6698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000069933c3d reply state 00000000c21dab0e transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683425.866090:0:6698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683425.866183:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:11324:x1876618802955136:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 1515us (1691us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1789683425.866191:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 139 00010000:00010000:0.0:1789683425.878858:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.878876:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.878896:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.878903:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683425.878908:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.878917:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.878933:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dbe60aa2300) 00010000:00010000:0.0:1789683425.878936:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683425.878940:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683425.878947:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff313 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683425.999147:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683425.999236:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802955264 00000100:00100000:2.0:1789683425.999249:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802955264 00000100:00100000:2.0:1789683425.999312:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 140 00000100:00100000:2.0:1789683425.999323:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:11332:x1876618802955264:12345-192.168.203.60@tcp:101:lctl.0 00010000:00010000:2.0:1789683425.999351:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683425.999375:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff31a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01da expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683425.999442:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff321 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683425.999456:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683425.999468:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683425.999505:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683425.999509:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683425.999531:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff321 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683425.999555:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff31a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01da expref: 16 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683425.999573:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff321 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01da expref: 15 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683425.999599:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:2.0:1789683425.999602:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683425.999605:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8d200, rc 0) 00000100:00100000:2.0:1789683425.999978:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:11332:x1876618802955264:12345-192.168.203.60@tcp:101:lctl.0 Request processed in 655us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683425.999987:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 140 00000100:00100000:2.0:1789683426.098777:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.099043:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802955392 00000100:00100000:0.0:1789683426.099053:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802955392 00000100:00100000:0.0:1789683426.099127:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:0.0:1789683426.099137:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+15:11338:x1876618802955392:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683426.099159:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683426.099178:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff328 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01e1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099237:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099252:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099265:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099279:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099287:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099294:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099389:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff33d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099398:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff33d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099405:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff33d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683426.099444:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789683426.099448:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683426.099466:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff33d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099478:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099485:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099493:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099499:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fc00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683426.099504:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099513:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099524:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:0.0:1789683426.099528:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683426.099532:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099539:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff32f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099552:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099568:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099575:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099580:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fa00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683426.099584:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099591:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099609:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8dbe60aa2300) 00010000:00010000:0.0:1789683426.099612:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683426.099614:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099620:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff336 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099650:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff328 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e1 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.099663:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff33d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e1 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.100766:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683426.100772:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789683426.100785:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f800, rc 0) 00000100:00100000:2.0:1789683426.103946:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:11338:x1876618802955392:12345-192.168.203.60@tcp:101:bash.0 Request processed in 4799us (5168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683426.103960:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 141 00000100:00100000:1.0:1789683426.108268:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.108345:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802955648 00000100:00100000:0.0:1789683426.108356:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802955648 00000100:00100000:0.0:1789683426.108413:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 142 00000100:00100000:0.0:1789683426.108424:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+16:11338:x1876618802955648:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683426.108446:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683426.108469:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff344 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01e8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.108597:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.108620:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.108631:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.108720:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.108731:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.108739:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789683426.109321:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1789683426.109482:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109493:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109509:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109562:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109571:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109579:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109586:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683426.109590:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109598:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109610:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683426.109612:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683426.109617:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109622:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff34b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683426.109634:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e43dd38 reply state 00000000c4c424b0 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683426.109643:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789683426.109710:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff344 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e8 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109725:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.109734:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe60aa2700) 00010000:00010000:0.0:1789683426.109736:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683426.109739:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e200, rc 0) 00000100:00100000:0.0:1789683426.109808:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11338:x1876618802955648:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1386us (1551us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789683426.109816:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 142 00000100:00100000:1.0:1789683426.116578:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.116706:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802955776 00000100:00100000:3.0:1789683426.116717:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802955776 00000100:00100000:3.0:1789683426.116787:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:3.0:1789683426.116798:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2352:x1876618802955776:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683426.116816:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683426.116835:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01ef expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683426.116861:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683426.116891:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=359s v=(0 0) 00010000:00010000:3.0:1789683426.116896:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683426.116905:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01ef expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.116923:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01ef expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.116957:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8600, rc 0) 00000100:00100000:3.0:1789683426.117022:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802955776:12345-192.168.203.60@tcp:101:bash.0 Request processed in 225us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683426.117029:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00010000:00010000:2.0:1789683426.117161:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.117170:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.117178:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.117184:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683426.117189:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.117198:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.117211:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe60aa2200) 00010000:00010000:2.0:1789683426.117214:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683426.117226:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.117233:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff352 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789683426.117356:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683426.120243:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.120316:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802955904 00000100:00100000:0.0:1789683426.120326:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802955904 00000100:00100000:0.0:1789683426.120387:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1789683426.120397:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:11338:x1876618802955904:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683426.120416:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683426.120435:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01f6 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.120467:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01ef expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.120476:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683426.120481:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683426.120486:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.120539:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01ef expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.120554:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01ef expref: 7 pid: 8465 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683426.120569:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6674:1876618815549056:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683426.120827:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48c8e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683426.124905:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a19f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6674:1876618815549056:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683426.124942:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.124965:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40fa00, rc 0) 00000100:00100000:1.0:1789683426.125029:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:11338:x1876618802955904:12345-192.168.203.60@tcp:101:bash.0 Request processed in 4632us (4794us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683426.125038:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:1.0:1789683426.125584:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.125739:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802956032 00000100:00100000:3.0:1789683426.125748:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802956032 00010000:00010000:3.0:1789683426.125783:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01ef expref: 7 pid: 8465 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683426.125820:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:3.0:1789683426.125830:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802956032:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683426.125843:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683426.125865:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01ef expref: 7 pid: 8465 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.125892:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01ef expref: 7 pid: 8465 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.125914:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ff367 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01ef expref: 7 pid: 8465 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.125930:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683426.125934:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683426.125942:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.125963:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.125997:0:5814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683426.126011:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c163b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1876618815549184:192.168.203.60@tcp:105: 00000100:00100000:3.0:1789683426.126084:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5309f780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683426.132963:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c163b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5814:1876618815549184:192.168.203.60@tcp:105: 00010000:00010000:3.0:1789683426.132989:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683426.133054:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2352:x1876618802956032:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 7224us (7470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683426.133064:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:0.0:1789683426.134380:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683426.134477:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802956288 00000100:00100000:2.0:1789683426.134485:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802956288 00000100:00100000:2.0:1789683426.134573:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:2.0:1789683426.134584:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:11338:x1876618802956288:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1789683426.134971:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11338:x1876618802956288:12345-192.168.203.60@tcp:35:bash.0 Request processed in 389us (595us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1789683426.134980:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1789683426.268455:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683426.268560:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802956544 00000100:00100000:2.0:1789683426.268574:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802956544 00000100:00100000:2.0:1789683426.268654:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:2.0:1789683426.268667:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11348:x1876618802956544:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683426.268720:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683426.268743:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff375 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f01fd expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683426.268833:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789683426.268976:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff375 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01fd expref: 21 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.268990:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:2.0:1789683426.268993:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683426.269011:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01fd expref: 21 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.269025:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8ca00, rc 0) 00000100:00100000:2.0:1789683426.269146:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:11348:x1876618802956544:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 481us (702us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1789683426.269153:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 143 00000100:00100000:2.0:1789683426.282550:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683426.282717:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802956800 00000100:00100000:1.0:1789683426.282727:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802956800 00000100:00100000:1.0:1789683426.282777:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:1.0:1789683426.282787:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:11348:x1876618802956800:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:1.0:1789683426.283039:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:11348:x1876618802956800:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 252us (499us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1789683426.283047:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:0.0:1789683426.393346:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683426.393456:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802956928 00000100:00100000:2.0:1789683426.393465:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802956928 00000100:00100000:2.0:1789683426.393522:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:2.0:1789683426.393532:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:11354:x1876618802956928:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683426.393563:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683426.393583:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0204 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.393662:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff38a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.393708:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff38a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.393724:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff38a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683426.393759:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789683426.393763:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683426.393779:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff38a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.393823:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0204 expref: 23 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.393842:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff38a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0204 expref: 22 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.393862:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:2.0:1789683426.393865:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683426.393869:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8da00, rc 0) 00000100:00100000:2.0:1789683426.393940:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:11354:x1876618802956928:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 409us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683426.393947:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 144 00000100:00100000:3.0:1789683426.406460:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.406914:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802957184 00000100:00100000:0.0:1789683426.406924:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802957184 00000100:00100000:0.0:1789683426.407031:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:0.0:1789683426.407042:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:11354:x1876618802957184:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683426.407063:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683426.407084:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff391 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f020b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.407204:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff398 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.407220:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.407232:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683426.407255:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789683426.407375:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff391 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f020b expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.407395:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f020b expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.407404:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe60aa2700) 00010000:00010000:0.0:1789683426.407407:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683426.407411:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ee00, rc 0) 00000100:00100000:0.0:1789683426.407476:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c163b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:11354:x1876618802957184:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 434us (1024us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1789683426.407490:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 145 00000100:00100000:2.0:1789683426.414724:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683426.414951:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802957312 00000100:00100000:1.0:1789683426.414961:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802957312 00000100:00100000:1.0:1789683426.415033:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1789683426.415043:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:2354:x1876618802957312:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683426.415058:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683426.415082:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff398 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f020b expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.415101:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe60aa2700) 00010000:00010000:1.0:1789683426.415107:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683426.415172:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:2354:x1876618802957312:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 130us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683426.415179:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:1.0:1789683426.422451:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.422533:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802957568 00000100:00100000:3.0:1789683426.422543:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802957568 00000100:00100000:3.0:1789683426.422610:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 146 00000100:00100000:3.0:1789683426.422621:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:11354:x1876618802957568:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683426.422643:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683426.422663:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0212 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.422797:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff3ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.422828:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff3ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.422973:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff3ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683426.422990:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789683426.423114:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0212 expref: 26 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.423135:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff3ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0212 expref: 25 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.423145:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe60aa2700) 00010000:00010000:3.0:1789683426.423148:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789683426.423152:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8a00, rc 0) 00000100:00100000:3.0:1789683426.423256:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11354:x1876618802957568:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 637us (813us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1789683426.423264:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 146 00000100:00100000:2.0:1789683426.437945:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.438038:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802957696 00000100:00100000:0.0:1789683426.438048:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802957696 00000100:00100000:0.0:1789683426.438109:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:0.0:1789683426.438119:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802957696:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:0.0:1789683426.438165:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.438184:0:6677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.438192:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789683426.438197:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683426.438201:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.438251:0:6677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.438265:0:6677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 6 pid: 6674 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683426.438279:0:6677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6677:1876618815549312:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683426.438363:0:6677:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48c8e780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683426.445756:0:6677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6677:1876618815549312:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683426.445788:0:6677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683426.452771:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.453064:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802957824 00000100:00100000:3.0:1789683426.453074:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802957824 00002000:00100000:3.0:1789683426.453126:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8dbe7c11aa00 x1876618802957824/t0(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:482/0 lens 504/0 e 0 to 0 dl 1789683437 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683426.453137:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe7c11aa00 with x1876618802957824 ext(0->12) 00010000:00010000:3.0:1789683426.453147:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 7 pid: 6674 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.453182:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 7 pid: 6674 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683426.453191:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dbe7c11aa00 00000100:00100000:3.0:1789683426.453227:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1789683426.453237:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802957824:12345-192.168.203.60@tcp:4:lfs.0 00000100:00100000:3.0:1789683426.453788:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2353:x1876618802957824:12345-192.168.203.60@tcp:4:lfs.0 Request processed in 549us (1024us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789683426.453797:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00002000:00100000:3.0:1789683426.453804:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8dbe7c11aa00 x1876618802957824/t4294967305(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:482/0 lens 504/448 e 0 to 0 dl 1789683437 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683426.453813:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe7c11aa00 with x1876618802957824 ext(0->12) 00010000:00010000:3.0:1789683426.453820:0:6681:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 9 pid: 6674 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.453833:0:6681:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 9 pid: 6674 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683426.454031:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8dbe7c11aa00 00000100:00100000:1.0:1789683426.466302:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.466932:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802957952 00000100:00100000:0.0:1789683426.466941:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802957952 00010000:00010000:0.0:1789683426.466983:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 9 pid: 6674 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683426.467030:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:0.0:1789683426.467040:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2352:x1876618802957952:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683426.467056:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789683426.467073:0:11663:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789683426.467077:0:11663:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789683426 00002000:00010000:0.0:1789683426.467079:0:11663:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789683426 00002000:00010000:0.0:1789683426.467082:0:11663:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789683426 00010000:00010000:0.0:1789683426.467101:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 9 pid: 6674 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.467116:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 9 pid: 6674 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.467141:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af2558ee/0x59bee33f93ff36e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01f6 expref: 9 pid: 6674 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.467157:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683426.467162:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683426.467168:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.467178:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.467317:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683426.467375:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802957952:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 336us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683426.467383:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:0.0:1789683426.471148:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.471185:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.471229:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.471257:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802958336 00000100:00100000:0.0:1789683426.471267:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802958336 00000100:00100000:0.0:1789683426.471330:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:0.0:1789683426.471341:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802958336:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683426.471429:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d02a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802958336:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 90us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683426.471437:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00080000:0.0:1789683426.471463:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683426.471661:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802958080 00000100:00100000:3.0:1789683426.471665:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802958080 00000100:00100000:3.0:1789683426.471727:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 303 00000100:00100000:3.0:1789683426.471735:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802958080:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683426.471779:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802958080:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 45us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683426.471786:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 303 00000100:00100000:2.0:1789683426.472609:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802958208 00000100:00100000:2.0:1789683426.472617:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802958208 00000100:00100000:2.0:1789683426.472727:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:2.0:1789683426.472738:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802958208:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683426.472787:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802958208:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 52us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683426.472795:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00010000:00010000:1.0:1789683426.472996:0:6677:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.473027:0:6677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.473061:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.473070:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.473080:0:6677:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.473088:0:6677:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fc00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683426.473093:0:6677:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.473102:0:6677:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.473121:0:6677:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683426.473129:0:6677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000177b8752/0x59bee33f93ff3bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683426.473191:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802957696:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 35073us (35256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683426.473199:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00080000:0.0:1789683426.473256:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683426.481720:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.481757:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802958592 00000100:00100000:3.0:1789683426.481767:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802958592 00000100:00100000:3.0:1789683426.481816:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1789683426.481826:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe708a2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11354:x1876618802958592:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:3.0:1789683426.481910:0:5832:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff3ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0212 expref: 25 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683426.482187:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:3.0:1789683426.482231:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:3.0:1789683426.482723:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:3.0:1789683426.482780:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.482797:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e8 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.482805:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.482837:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e8 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.482851:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e8 expref: 29 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683426.482890:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c161880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1876618815549440:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683426.482981:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5309f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683426.491302:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683426.491723:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802958720 00000100:00100000:2.0:1789683426.491734:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802958720 00010000:00010000:2.0:1789683426.491773:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e8 expref: 30 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683426.491828:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:2.0:1789683426.491849:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:2352:x1876618802958720:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683426.491864:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683426.491872:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e8 expref: 30 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.491894:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e8 expref: 30 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.491914:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe60aa2700) 00010000:00010000:2.0:1789683426.491920:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.491930:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.491938:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.491957:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683426.492013:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:2352:x1876618802958720:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 166us (721us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683426.492020:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00010000:00010000:3.0:1789683426.492747:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff359 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e8 expref: 29 pid: 5831 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683426.492765:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c161880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5832:1876618815549440:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683426.492784:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.492793:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.492799:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683426.492938:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:3.0:1789683426.493130:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:3.0:1789683426.493246:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c161880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1876618815549568:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789683426.493301:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683426.493330:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5309ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683426.493770:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815549568 00000100:00100000:0.0:1789683426.493777:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815549568 00000100:00100000:0.0:1789683426.493834:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683426.493852:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1876618815549568:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789683426.493934:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c162d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1876618815549568:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 84us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683426.493941:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789683426.494048:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683426.494134:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c161880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1876618815549568:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789683426.495209:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1789683426.495284:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c161880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1876618815549696:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789683426.495330:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683426.495362:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683426.496277:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815549696 00000100:00100000:0.0:1789683426.496287:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815549696 00000100:00100000:0.0:1789683426.496336:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683426.496345:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1876618815549696:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789683426.498891:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c160700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1876618815549696:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 2531us (3545us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789683426.498904:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789683426.499018:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c161880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5832:1876618815549696:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1789683426.499121:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1789683426.499177:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.499188:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.499196:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.499203:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683426.499208:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.499217:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.499233:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe60aa2700) 00010000:00010000:3.0:1789683426.499236:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789683426.499242:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.499249:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff3c2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683426.502312:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789683426.502506:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:3.0:1789683426.502520:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360133846100ns, next at 361133843061ns, rc = 0 00000001:00080000:3.0:1789683426.502531:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1789683426.502604:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe60aa2700) 00010000:00010000:3.0:1789683426.502609:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789683426.502636:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff3ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0212 expref: 33 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683426.503070:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe708a2050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11354:x1876618802958592:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 21242us (21356us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1789683426.503080:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000020:00080000:3.0:1789683426.503087:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789683426.506453:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.506533:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802958848 00000100:00100000:3.0:1789683426.506544:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802958848 00000100:00100000:3.0:1789683426.506600:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:3.0:1789683426.506610:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11354:x1876618802958848:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683426.506635:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683426.506657:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff3c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0219 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.506751:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0219 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.506767:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0219 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.506785:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683426.506789:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683426.506793:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8400, rc 0) 00000100:00100000:3.0:1789683426.506843:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:11354:x1876618802958848:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 235us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683426.506851:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 147 00000100:00100000:1.0:1789683426.510138:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683426.510230:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802959104 00000100:00100000:2.0:1789683426.510239:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802959104 00000100:00100000:2.0:1789683426.510296:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:2.0:1789683426.510306:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:11354:x1876618802959104:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1789683426.510555:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:11354:x1876618802959104:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 250us (424us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789683426.510564:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:1.0:1789683426.599389:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683426.599499:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802959360 00000100:00100000:2.0:1789683426.599510:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802959360 00000100:00100000:2.0:1789683426.599567:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:2.0:1789683426.599576:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:11364:x1876618802959360:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683426.599608:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683426.599627:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93ff3d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0220 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683426.599738:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789683426.599853:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93ff3d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0220 expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.599867:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:2.0:1789683426.599869:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683426.599882:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c800/0x59bee33f93ff3d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0220 expref: 36 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.599897:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe59f8c800, rc 0) 00000100:00100000:2.0:1789683426.599946:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76129880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:11364:x1876618802959360:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 371us (564us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1789683426.599955:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 148 00000100:00100000:0.0:1789683426.603210:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683426.603361:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802959488 00000100:00100000:2.0:1789683426.603370:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802959488 00000100:00100000:2.0:1789683426.603428:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:2.0:1789683426.603452:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:11364:x1876618802959488:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:2.0:1789683426.603537:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603555:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603567:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603581:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603588:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603603:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603726:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603737:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603744:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683426.603786:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603799:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603812:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603819:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603825:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683426.603830:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603849:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603860:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:2.0:1789683426.603863:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683426.603868:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603882:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d600/0x59bee33f93ff3de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603896:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603901:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603906:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603911:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8ca00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683426.603920:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603926:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603935:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe6097ca00) 00010000:00010000:2.0:1789683426.603937:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683426.603940:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603946:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8ca00/0x59bee33f93ff3e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603962:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603967:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603972:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603977:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683426.603979:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603985:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.603991:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:2.0:1789683426.603993:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683426.604001:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.604008:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff3ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683426.604085:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:11364:x1876618802959488:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 635us (882us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683426.604094:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 149 00000100:00100000:1.0:1789683426.606767:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.606863:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802959744 00000100:00100000:3.0:1789683426.606894:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802959744 00000100:00100000:3.0:1789683426.606947:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:3.0:1789683426.606957:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:11364:x1876618802959744:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1789683426.607186:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11364:x1876618802959744:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 230us (427us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1789683426.607194:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:1.0:1789683426.643580:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683426.643724:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802960000 00000100:00100000:0.0:1789683426.643734:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802960000 00000100:00100000:0.0:1789683426.643798:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 150 00000100:00100000:0.0:1789683426.643808:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11367:x1876618802960000:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683426.643863:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683426.643893:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff3f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0227 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.643971:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.643986:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.643998:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644012:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644019:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644025:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644136:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644146:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644154:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683426.644164:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789683426.644263:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644272:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644280:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644287:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683426.644292:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644300:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644314:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683426.644318:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683426.644323:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644330:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff3fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644344:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644351:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644357:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644362:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fa00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683426.644371:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644378:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644386:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe60aa2300) 00010000:00010000:0.0:1789683426.644388:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683426.644405:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644412:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644455:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff3f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0227 expref: 39 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644468:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0227 expref: 38 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683426.644475:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683426.644477:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683426.644480:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e200, rc 0) 00000100:00100000:0.0:1789683426.644542:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+38:11367:x1876618802960000:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 735us (971us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789683426.644551:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 150 00000100:00100000:0.0:1789683426.648575:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683426.648954:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802960128 00000100:00100000:2.0:1789683426.648964:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802960128 00000100:00100000:2.0:1789683426.649024:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:2.0:1789683426.649033:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+38:11367:x1876618802960128:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:2.0:1789683426.649097:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.649115:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.649126:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.649153:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.649161:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.649168:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.649175:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683426.649191:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.649200:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.649213:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:2.0:1789683426.649216:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683426.649221:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683426.649228:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683426.649302:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+38:11367:x1876618802960128:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 269us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683426.649310:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 151 00000100:00100000:1.0:1789683426.652107:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.652191:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802960384 00000100:00100000:3.0:1789683426.652202:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802960384 00000100:00100000:3.0:1789683426.652265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:3.0:1789683426.652276:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+38:11367:x1876618802960384:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1789683426.652897:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+39:11367:x1876618802960384:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 600us (776us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789683426.652906:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:0.0:1789683426.784197:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683426.784219:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815549824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683426.784312:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683426.784437:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815549824 00000100:00100000:2.0:1789683426.784446:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815549824 00000100:00100000:2.0:1789683426.784526:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789683426.784537:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815549824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683426.784576:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683426.784604:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815550080:0@lo:400:kworker.0 00000100:00100000:2.0:1789683426.784644:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815549824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683426.784650:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683426.784659:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789683426.784705:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815550336:0@lo:400:kworker.0 00000100:00100000:1.0:1789683426.784707:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683426.784717:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815550208:0@lo:400:kworker.0 00000100:00100000:2.0:1789683426.784741:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683426.784772:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683426.784778:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe48a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815549952:0@lo:400:kworker.0 00000100:00100000:2.0:1789683426.784820:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683426.784858:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815549952 00000100:00100000:2.0:1789683426.784863:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815549952 00000100:00100000:2.0:1789683426.784903:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789683426.784911:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815549952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683426.784953:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53158450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3304:x1876618815549952:12345-0@lo:400:kworker.0 Request processed in 43us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683426.784960:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1789683426.785008:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe48a5d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815549952:0@lo:400:kworker.0 00000100:00100000:1.0:1789683426.785074:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789683426.785218:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683426.785261:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:0.0:1789683426.785266:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe7c11a680, transno 4294967312 00000100:00100000:0.0:1789683426.785282:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c160380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815549824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683426.788667:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815550080 00000100:00100000:2.0:1789683426.788696:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815550080 00000100:00100000:2.0:1789683426.788758:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815550336 00000100:00100000:2.0:1789683426.788762:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815550336 00000100:00100000:2.0:1789683426.788804:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815550208 00000100:00100000:2.0:1789683426.788809:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815550208 00000100:00100000:2.0:1789683426.788832:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789683426.788842:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815550080:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789683426.788868:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683426.788942:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815550080:12345-0@lo:400:kworker.0 Request processed in 102us (4296us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683426.788950:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789683426.788966:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789683426.794363:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789683426.794454:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815550208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683426.794455:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815550336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683426.794627:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815550080:0@lo:400:kworker.0 00000100:00100000:2.0:1789683426.803398:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815550336:12345-0@lo:400:kworker.0 Request processed in 14415us (18646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683426.803413:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1789683426.804577:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815550336:0@lo:400:kworker.0 00000100:00100000:0.0:1789683426.808971:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815550208:12345-0@lo:400:kworker.0 Request processed in 14587us (23899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683426.808987:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1789683426.809107:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53f67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815550208:0@lo:400:kworker.0 00010000:00010000:0.0:1789683426.850197:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683426.874225:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1789683426.874242:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:1.0:1789683426.936173:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.936274:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802960640 00000100:00100000:3.0:1789683426.936286:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802960640 00000100:00100000:3.0:1789683426.936357:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00100000:3.0:1789683426.936369:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+39:11398:x1876618802960640:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1789683426.936402:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683426.936425:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff41d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f022e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.936783:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff424 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.937008:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.937020:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff424 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683426.937035:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789683426.937180:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff41d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f022e expref: 42 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.937204:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff424 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f022e expref: 41 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.937213:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683426.937216:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683426.937220:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8600, rc 0) 00000100:00100000:3.0:1789683426.937300:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+41:11398:x1876618802960640:12345-192.168.203.60@tcp:101:cat.0 Request processed in 933us (1135us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789683426.937309:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 152 00000100:00100000:0.0:1789683426.945890:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683426.946284:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683426.948252:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802961024 00000100:00100000:3.0:1789683426.948266:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802961024 00000100:00100000:2.0:1789683426.948449:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802960896 00000100:00100000:2.0:1789683426.948466:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802960896 00000100:00100000:2.0:1789683426.948504:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:2.0:1789683426.948513:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+42:11398:x1876618802960896:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:3.0:1789683426.948668:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1789683426.948706:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+43:2354:x1876618802961024:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683426.948719:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683426.948748:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff424 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f022e expref: 43 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683426.948782:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683426.948788:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683426.948805:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+42:11398:x1876618802960896:12345-192.168.203.60@tcp:35:cat.0 Request processed in 291us (2934us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1789683426.948812:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:3.0:1789683426.948915:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+41:2354:x1876618802961024:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 212us (2631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683426.948923:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1789683427.026782:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.026979:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802961280 00000100:00100000:3.0:1789683427.026990:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802961280 00000100:00080000:1.0:1789683427.027142:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683427.027190:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:3.0:1789683427.027202:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+41:11404:x1876618802961280:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1789683427.027225:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683427.027228:0:9827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789683427.027254:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8da00/0x59bee33f93ff38a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0204 expref: 41 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.027274:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:3.0:1789683427.027279:0:9827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683427.027293:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff432 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0235 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.027433:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.027448:0:9827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0227 expref: 41 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.027456:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.027493:0:9827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0227 expref: 41 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.027506:0:9827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0227 expref: 41 pid: 6698 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683427.027520:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c163800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815550464:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683427.027805:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683427.032826:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c163800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815550464:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683427.032855:0:9827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683427.038779:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.038990:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802961408 00000100:00100000:3.0:1789683427.039002:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802961408 00010000:00010000:3.0:1789683427.039042:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0227 expref: 42 pid: 6698 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683427.039087:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:3.0:1789683427.039097:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+42:2352:x1876618802961408:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683427.039112:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683427.039118:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0227 expref: 42 pid: 6698 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.039130:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0227 expref: 42 pid: 6698 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.039173:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff408 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0227 expref: 42 pid: 6698 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.039189:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683427.039194:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.039203:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.039210:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.039246:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683427.039305:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+41:2352:x1876618802961408:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 210us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683427.039312:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00010000:00010000:0.0:1789683427.039551:0:9827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.039560:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683427.039579:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789683427.039769:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff432 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0235 expref: 42 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.039786:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0235 expref: 41 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.039793:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683427.039803:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789683427.039806:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8a00, rc 0) 00000100:00100000:0.0:1789683427.039838:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+41:11404:x1876618802961280:12345-192.168.203.60@tcp:101:dd.0 Request processed in 12639us (13067us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789683427.039845:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 153 00000100:00100000:0.0:1789683427.045046:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.045136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802961664 00000100:00100000:3.0:1789683427.045147:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802961664 00000100:00100000:3.0:1789683427.045214:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 154 00000100:00100000:3.0:1789683427.045225:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+41:11404:x1876618802961664:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:3.0:1789683427.046045:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.046064:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.046075:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683427.046147:0:5830:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1789683427.046171:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7780b12 reply state 00000000aea78912 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683427.046180:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683427.046317:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+44:11404:x1876618802961664:12345-192.168.203.60@tcp:36:dd.0 Request processed in 1092us (1280us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1789683427.046325:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 154 00000020:00080000:3.0:1789683427.046331:0:5830:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789683427.050493:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.050510:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.050518:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.050525:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683427.050530:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.050538:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.050554:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683427.050556:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683427.050561:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.050568:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff447 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683427.345847:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.346009:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802961792 00000100:00100000:3.0:1789683427.346019:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802961792 00000100:00100000:3.0:1789683427.346070:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 155 00000100:00100000:3.0:1789683427.346081:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+43:11418:x1876618802961792:12345-192.168.203.60@tcp:101:stat.0 00010000:00010000:3.0:1789683427.346110:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683427.346131:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff44e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f023c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.346194:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.346277:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.346290:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.346306:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.346328:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.346335:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.347464:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.347483:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0235 expref: 44 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.347490:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.347526:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0235 expref: 44 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.348316:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0235 expref: 44 pid: 9827 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683427.348334:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c163800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815550592:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683427.348486:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683427.367373:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.367473:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c163800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815550592:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683427.367498:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683427.367999:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802962048 00000100:00100000:0.0:1789683427.368007:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802962048 00000100:00100000:0.0:1789683427.368080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1789683427.368090:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+45:5585:x1876618802962048:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789683427.369450:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+46:5585:x1876618802962048:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 1354us (2078us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789683427.369461:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:0.0:1789683427.375110:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683427.375170:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802962176 00000100:00100000:1.0:1789683427.375181:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802962176 00010000:00010000:1.0:1789683427.375222:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0235 expref: 46 pid: 9827 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683427.375284:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:1.0:1789683427.375295:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+46:2353:x1876618802962176:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683427.375308:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683427.375316:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0235 expref: 46 pid: 9827 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.375329:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0235 expref: 46 pid: 9827 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.375350:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff439 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0235 expref: 46 pid: 9827 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.375365:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:1.0:1789683427.375370:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.375380:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.375387:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.375414:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683427.375461:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+45:2353:x1876618802962176:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 168us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683427.375468:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00010000:00010000:3.0:1789683427.375539:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375554:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683427.375607:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789683427.375612:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683427.375631:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375643:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375653:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375660:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375667:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375700:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683427.375705:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375713:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375721:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:3.0:1789683427.375724:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683427.375728:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375744:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375756:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375762:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375768:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375773:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683427.375775:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375781:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375787:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe5931e800) 00010000:00010000:3.0:1789683427.375789:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683427.375792:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.375798:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff45c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.376013:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff44e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f023c expref: 45 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.376029:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f023c expref: 44 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.376042:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683427.376045:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683427.376047:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9c00, rc 0) 00000100:00100000:3.0:1789683427.376076:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+44:11418:x1876618802961792:12345-192.168.203.60@tcp:101:stat.0 Request processed in 29997us (30241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683427.376082:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 155 00000001:00080000:0.0:1789683427.384185:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000001:00080000:0.0:1789683427.384227:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967441 is committed 00000004:00080000:0.0:1789683427.384242:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789683427.384268:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dbe5309f0c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789683427.384273:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe7c174800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe70c613c0 00000020:00080000:0.0:1789683427.384276:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe7c174200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe5108e800 00000020:00080000:3.0:1789683427.384669:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789683427.384897:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1789683427.385412:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683427.385430:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c11a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815550720:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789683427.385502:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683427.385573:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815550720 00000100:00100000:1.0:1789683427.385603:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815550720 00000100:00100000:1.0:1789683427.385660:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789683427.385669:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815550720:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1789683427.385727:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1789683427.385760:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aac66e2, atime: 0x6aac66e2, ctime: 0x6aac66e2, blocks: 0xb 00010000:00010000:1.0:1789683427.385768:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.385785:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1789683427.385790:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683427.385796:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.385813:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.385824:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.385842:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.386073:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789683427.386722:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c163800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815550720:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1051us (1216us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789683427.386731:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789683427.386903:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1789683427.386909:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1789683427.386929:0:3304:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8dbe7c11a680 x1876618815550720/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789683443 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789683427.386941:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe7c11a680/2, rc 0, transno 4294967307 00000100:00100000:3.0:1789683427.386946:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c11a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815550720:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1789683427.391402:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683427.391418:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.391431:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683427.391436:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.391448:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.391470:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.391478:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ff46a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.391522:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683427.391524:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683427.391527:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683427.438998:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683427.439270:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802962432 00000100:00100000:0.0:1789683427.439281:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802962432 00000100:00100000:0.0:1789683427.439343:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 156 00000100:00100000:0.0:1789683427.439354:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:11424:x1876618802962432:12345-192.168.203.60@tcp:36:truncate.0 00010000:00010000:0.0:1789683427.439413:0:9827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683427.439443:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f023c expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.439464:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683427.439469:0:9827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683427.439735:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.439749:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.439776:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683427.439832:0:9827:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1789683427.439859:0:9827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000014604f86 reply state 00000000296a2327 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683427.439879:0:9827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683427.439982:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11424:x1876618802962432:12345-192.168.203.60@tcp:36:truncate.0 Request processed in 629us (992us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1789683427.439990:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 156 00000020:00080000:0.0:1789683427.439995:0:9827:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789683427.445579:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.445609:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.445617:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.445622:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683427.445627:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.445634:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.445650:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683427.445653:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683427.445700:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.445707:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff471 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683427.663037:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.663483:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802962560 00000100:00100000:3.0:1789683427.663494:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802962560 00000100:00100000:3.0:1789683427.663557:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 157 00000100:00100000:3.0:1789683427.663568:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:11439:x1876618802962560:12345-192.168.203.60@tcp:101:stat.0 00010000:00010000:3.0:1789683427.663610:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683427.663633:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff478 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0243 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.663765:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.663780:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.663792:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.663808:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.663815:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.663821:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664133:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664143:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664150:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683427.664191:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789683427.664195:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683427.664215:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664236:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664246:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664253:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664260:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664266:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683427.664270:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664278:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664290:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:3.0:1789683427.664293:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683427.664299:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664306:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff47f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664319:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664324:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664340:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664345:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683427.664348:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664354:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664361:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe5931e800) 00010000:00010000:3.0:1789683427.664364:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683427.664367:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664373:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff486 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664410:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff478 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0243 expref: 20 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664424:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0243 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.664431:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683427.664433:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683427.664436:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9c00, rc 0) 00000100:00100000:3.0:1789683427.664515:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11439:x1876618802962560:12345-192.168.203.60@tcp:101:stat.0 Request processed in 948us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683427.664533:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 157 00000100:00100000:2.0:1789683427.806537:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.806988:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802962816 00000100:00100000:3.0:1789683427.807007:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802962816 00000100:00100000:3.0:1789683427.807149:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:3.0:1789683427.807162:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11449:x1876618802962816:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683427.807191:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683427.807230:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff494 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f024a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683427.807366:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789683427.807523:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff494 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f024a expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.807542:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:3.0:1789683427.807546:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683427.807553:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f024a expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.807575:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9600, rc 0) 00000100:00100000:3.0:1789683427.809497:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:11449:x1876618802962816:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 2325us (2956us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1789683427.809511:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 158 00000100:00100000:0.0:1789683427.815251:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683427.815377:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802963072 00000100:00100000:2.0:1789683427.815390:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802963072 00000100:00100000:2.0:1789683427.816223:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:2.0:1789683427.816253:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7085d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:11449:x1876618802963072:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1789683427.817115:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7085d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:11449:x1876618802963072:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 867us (1930us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1789683427.817127:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00010000:00010000:1.0:1789683427.872007:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683427.914567:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.914757:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802963328 00000100:00100000:3.0:1789683427.914772:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802963328 00000100:00100000:3.0:1789683427.914850:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:3.0:1789683427.914862:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:11455:x1876618802963328:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683427.914937:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683427.914967:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff4a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0251 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.915110:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.915128:0:9827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0243 expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.915139:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.916394:0:9827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0243 expref: 22 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.916448:0:9827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0243 expref: 22 pid: 5830 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683427.916482:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c161880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815550848:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683427.918116:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe62011f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683427.923023:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c161880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815550848:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683427.923065:0:9827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683427.939033:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.942742:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802963456 00000100:00100000:3.0:1789683427.942766:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802963456 00010000:00010000:3.0:1789683427.943624:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0243 expref: 23 pid: 5830 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683427.944383:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:3.0:1789683427.944407:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:2353:x1876618802963456:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683427.944452:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683427.944463:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0243 expref: 23 pid: 5830 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.944480:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0243 expref: 23 pid: 5830 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.944506:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff48d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0243 expref: 23 pid: 5830 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.944527:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683427.944532:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.944554:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.944563:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.944595:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683427.944707:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:2353:x1876618802963456:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 312us (5689us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683427.944715:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00010000:00010000:1.0:1789683427.944789:0:9827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.944799:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683427.944824:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1789683427.945040:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9600/0x59bee33f93ff4a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0251 expref: 23 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.945059:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0251 expref: 22 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683427.945067:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:1.0:1789683427.945071:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789683427.945074:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8200, rc 0) 00000100:00100000:1.0:1789683427.945107:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:11455:x1876618802963328:12345-192.168.203.60@tcp:101:bash.0 Request processed in 30248us (30569us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789683427.945115:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 159 00000100:00100000:0.0:1789683427.957195:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683427.957273:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802963712 00000100:00100000:0.0:1789683427.957287:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802963712 00000100:00100000:0.0:1789683427.957355:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 160 00000100:00100000:0.0:1789683427.957366:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:11455:x1876618802963712:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:0.0:1789683427.957757:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.957780:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.957795:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683427.957886:0:6698:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1789683427.957916:0:6698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0a34649 reply state 0000000022868c87 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683427.957950:0:6698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683427.958075:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11455:x1876618802963712:12345-192.168.203.60@tcp:36:bash.0 Request processed in 708us (892us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1789683427.958083:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 160 00000020:00080000:0.0:1789683427.958089:0:6698:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789683427.960499:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.960520:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.960529:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.960536:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683427.960542:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.960551:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.960572:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683427.960576:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683427.960582:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.960589:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683427.973115:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683427.974744:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802963840 00000100:00100000:3.0:1789683427.974762:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802963840 00000100:00100000:3.0:1789683427.974849:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 161 00000100:00100000:3.0:1789683427.974862:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:11455:x1876618802963840:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683427.974927:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683427.974956:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff4be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0258 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.975088:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.975112:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0251 expref: 25 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.975130:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.975183:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0251 expref: 25 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683427.975200:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0251 expref: 25 pid: 9827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683427.975218:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c163100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815550976:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683427.975346:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe62011cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683427.977993:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c163100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815550976:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683427.978034:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683427.978447:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683427.978530:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802963968 00000100:00100000:2.0:1789683427.978539:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802963968 00010000:00010000:2.0:1789683427.978587:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0251 expref: 26 pid: 9827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683427.978634:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:2.0:1789683427.978645:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:2353:x1876618802963968:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683427.978664:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683427.978695:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0251 expref: 26 pid: 9827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.978710:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0251 expref: 26 pid: 9827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.978736:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff4a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0251 expref: 26 pid: 9827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.978776:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:2.0:1789683427.978782:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.978794:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.978805:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683427.978847:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683427.979014:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.979022:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683427.979083:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789683427.979089:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683427.979116:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.979154:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff4be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0258 expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.979174:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0258 expref: 25 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683427.979182:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683427.979185:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683427.979188:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8600, rc 0) 00000100:00100000:0.0:1789683427.979329:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11455:x1876618802963840:12345-192.168.203.60@tcp:101:bash.0 Request processed in 4469us (6231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683427.979339:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 161 00000100:00100000:2.0:1789683427.979544:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:2353:x1876618802963968:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 899us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683427.979553:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:0.0:1789683428.000814:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683428.005059:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802964224 00000100:00100000:2.0:1789683428.005085:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802964224 00000100:00100000:2.0:1789683428.005195:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:2.0:1789683428.005218:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:11455:x1876618802964224:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1789683428.006402:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11455:x1876618802964224:12345-192.168.203.60@tcp:35:bash.0 Request processed in 1184us (5592us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789683428.006417:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:0.0:1789683428.131148:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683428.131366:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802964480 00000100:00100000:1.0:1789683428.131381:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802964480 00000100:00100000:1.0:1789683428.131464:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:1.0:1789683428.131476:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11465:x1876618802964480:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683428.131528:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683428.131557:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff4cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f025f expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683428.131746:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789683428.131927:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff4cc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f025f expref: 27 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.131962:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:1.0:1789683428.131966:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683428.131973:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7e00/0x59bee33f93ff4cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f025f expref: 27 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.131992:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7e00, rc 0) 00000100:00100000:1.0:1789683428.132094:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11465:x1876618802964480:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 620us (959us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1789683428.132103:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 162 00000100:00100000:1.0:1789683428.135923:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683428.136278:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802964608 00000100:00100000:0.0:1789683428.136292:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802964608 00000100:00100000:0.0:1789683428.136381:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:0.0:1789683428.136394:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11465:x1876618802964608:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1789683428.136539:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.136560:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.136575:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.136594:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.136601:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.136609:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137028:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137039:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137060:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683428.137113:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137130:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137149:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137158:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137166:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683428.137171:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137180:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137194:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683428.137198:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683428.137204:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137211:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137226:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137232:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137238:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137243:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ee00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683428.137255:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137262:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137271:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe60aa2300) 00010000:00010000:0.0:1789683428.137274:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683428.137276:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137283:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137301:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137308:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137314:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137321:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683428.137324:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137330:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137337:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683428.137339:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683428.137350:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.137356:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683428.137470:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11465:x1876618802964608:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 1076us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683428.137480:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 163 00000100:00100000:3.0:1789683428.149616:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683428.158278:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802964864 00000100:00100000:2.0:1789683428.158296:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802964864 00000100:00100000:2.0:1789683428.159229:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:2.0:1789683428.159244:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11465:x1876618802964864:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1789683428.161070:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:11465:x1876618802964864:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 1819us (11460us total) trans 4294967452 rc 0/0 00000100:00100000:2.0:1789683428.161107:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:2.0:1789683428.246924:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683428.247178:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802965120 00000100:00100000:0.0:1789683428.247189:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802965120 00000100:00100000:0.0:1789683428.247249:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00100000:0.0:1789683428.247259:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:11468:x1876618802965120:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:0.0:1789683428.247284:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683428.247307:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0266 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247378:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247391:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247404:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247417:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247424:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247448:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247808:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247829:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247837:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683428.247848:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789683428.247954:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247962:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247969:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247975:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ee00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683428.247980:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.247989:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248000:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683428.248004:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683428.248017:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248023:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff4f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248036:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248043:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248049:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248054:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683428.248057:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248063:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248071:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe60aa2300) 00010000:00010000:0.0:1789683428.248074:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683428.248076:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248082:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e600/0x59bee33f93ff4fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248126:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e800/0x59bee33f93ff4ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0266 expref: 30 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248152:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0266 expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.248159:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683428.248161:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683428.248164:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40fc00, rc 0) 00000100:00100000:0.0:1789683428.248229:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:11468:x1876618802965120:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 971us (1313us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1789683428.248236:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 164 00000100:00100000:3.0:1789683428.257058:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683428.257099:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683428.257204:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802965376 00000100:00100000:0.0:1789683428.257204:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802965248 00000100:00100000:2.0:1789683428.257213:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802965376 00000100:00100000:0.0:1789683428.257213:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802965248 00000100:00100000:2.0:1789683428.257276:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:0.0:1789683428.257277:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:2.0:1789683428.257287:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:11468:x1876618802965376:12345-192.168.203.60@tcp:54:lfs.0 00000100:00100000:0.0:1789683428.257287:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:2352:x1876618802965248:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683428.257304:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683428.257328:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0266 expref: 30 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683428.257347:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683428.257348:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:0.0:1789683428.257353:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683428.257362:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683428.257372:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683428.257403:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683428.257410:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c162300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:2352:x1876618802965248:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 125us (360us total) trans 0 rc 0/0 00010000:00010000:2.0:1789683428.257411:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683428.257417:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00010000:00010000:2.0:1789683428.257418:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683428.257424:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683428.257428:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683428.257436:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683428.257455:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:2.0:1789683428.257457:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683428.257462:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683428.257468:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff512 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683428.257516:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c160000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:11468:x1876618802965376:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 231us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683428.257522:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 165 00000100:00100000:0.0:1789683428.270995:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683428.275008:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802965632 00000100:00100000:1.0:1789683428.275021:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802965632 00000100:00100000:0.0:1789683428.275243:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1789683428.275254:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:11468:x1876618802965632:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683428.275517:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:11468:x1876618802965632:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 264us (4529us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789683428.275525:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1789683428.437748:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683428.437840:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802965888 00000100:00100000:3.0:1789683428.437849:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802965888 00000100:00100000:3.0:1789683428.437980:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:3.0:1789683428.437991:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:11486:x1876618802965888:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:3.0:1789683428.438021:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683428.438041:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff519 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f026d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.438140:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff520 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.438155:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff520 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.438168:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff520 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683428.438181:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789683428.438303:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff519 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f026d expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.438324:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff520 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f026d expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.438332:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683428.438335:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789683428.438339:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9c00, rc 0) 00000100:00100000:3.0:1789683428.438510:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11486:x1876618802965888:12345-192.168.203.60@tcp:101:cat.0 Request processed in 520us (769us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789683428.438534:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 166 00000100:00100000:3.0:1789683428.474979:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683428.475221:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802966016 00000100:00100000:1.0:1789683428.475231:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802966016 00000100:00100000:1.0:1789683428.475295:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:1.0:1789683428.475305:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11487:x1876618802966016:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683428.475335:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683428.475355:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff52e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0274 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.475961:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.475977:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.475990:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683428.476041:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789683428.476046:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789683428.476064:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.476092:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff52e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0274 expref: 33 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.476112:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0274 expref: 32 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.476119:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683428.476122:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683428.476126:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7c00, rc 0) 00000100:00100000:1.0:1789683428.476194:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c161880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11487:x1876618802966016:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 891us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683428.476201:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 167 00000100:00100000:1.0:1789683428.485285:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683428.485386:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802966400 00000100:00100000:2.0:1789683428.485406:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802966400 00000100:00100000:2.0:1789683428.485469:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:2.0:1789683428.485479:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11487:x1876618802966400:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1789683428.486357:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:11487:x1876618802966400:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 875us (1082us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1789683428.486366:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1789683428.490775:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683428.490918:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802966528 00000100:00100000:3.0:1789683428.490928:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802966528 00000100:00100000:3.0:1789683428.490993:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1789683428.491003:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:11487:x1876618802966528:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:3.0:1789683428.491018:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789683428.491042:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff4c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0258 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.491066:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff520 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f026d expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.491078:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff3c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0219 expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.491088:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683428.491099:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683428.491155:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c23800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:11487:x1876618802966528:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 154us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683428.491163:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1789683428.493126:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683428.493211:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802966656 00000100:00100000:1.0:1789683428.493221:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802966656 00000100:00100000:1.0:1789683428.493273:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:1.0:1789683428.493283:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:11487:x1876618802966656:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:1.0:1789683428.493409:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.493424:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683428.493446:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683428.494105:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1789683428.494201:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c160380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:11487:x1876618802966656:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 918us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683428.494210:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 168 00000100:00100000:0.0:1789683428.521461:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683428.521610:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802966784 00000100:00100000:3.0:1789683428.521620:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802966784 00000100:00100000:3.0:1789683428.521715:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 169 00000100:00100000:3.0:1789683428.521728:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+30:11489:x1876618802966784:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683428.521765:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683428.521785:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff543 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f027b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.521885:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.521901:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.521912:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.521925:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.521933:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.521939:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522203:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522212:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522219:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683428.522253:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789683428.522264:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683428.522285:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522296:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522303:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522309:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522315:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522320:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683428.522324:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522331:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522342:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:3.0:1789683428.522345:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683428.522349:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522355:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff54a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522369:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522384:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522648:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522653:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683428.522656:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522663:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522703:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe5931e500) 00010000:00010000:3.0:1789683428.522706:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683428.522709:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522716:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff551 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522749:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff543 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f027b expref: 32 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522762:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f027b expref: 31 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683428.522768:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9300) 00010000:00010000:3.0:1789683428.522770:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683428.522779:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8a00, rc 0) 00000100:00100000:3.0:1789683428.522936:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11489:x1876618802966784:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1209us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683428.522944:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 169 00010000:00010000:0.0:1789683428.896827:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683429.279882:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683429.279893:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683429.280334:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789683429.280341:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683429.280459:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815551104:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789683429.280823:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683429.297740:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca0700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815551104:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789683429.304813:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683429.305251:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802966912 00000100:00100000:3.0:1789683429.305260:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802966912 00000100:00100000:3.0:1789683429.305327:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:3.0:1789683429.305336:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11500:x1876618802966912:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789683429.305367:0:9827:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1789683429.305457:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683429.305559:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11500:x1876618802966912:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 223us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.305574:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 170 00000100:00100000:1.0:1789683429.316824:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683429.319942:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802967040 00000100:00100000:0.0:1789683429.319956:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802967040 00000100:00100000:0.0:1789683429.320063:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 171 00000100:00100000:0.0:1789683429.320072:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11500:x1876618802967040:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789683429.321382:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321403:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321416:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321433:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321441:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321447:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321475:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321491:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321497:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683429.321540:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789683429.321544:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683429.321558:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321569:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321577:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321584:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321591:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683429.321595:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321601:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321613:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:0.0:1789683429.321616:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683429.321621:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321638:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff55f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321652:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321658:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321664:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321669:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683429.321686:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321693:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321700:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8dbe60aa2000) 00010000:00010000:0.0:1789683429.321703:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683429.321706:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321712:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff566 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321729:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321735:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321746:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321766:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fa00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683429.321770:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321777:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321785:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9300) 00010000:00010000:0.0:1789683429.321788:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683429.321791:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.321798:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fa00/0x59bee33f93ff56d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683429.321903:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11500:x1876618802967040:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 1828us (5085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683429.321913:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 171 00000040:00080000:3.0:1789683429.331538:0:12459:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789683429.331546:0:12459:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789683429.331580:0:12459:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789683429.331586:0:12459:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683429.332929:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683429.332980:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802967296 00000100:00100000:2.0:1789683429.332990:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802967296 00000100:00100000:2.0:1789683429.337437:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:2.0:1789683429.337460:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11500:x1876618802967296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683429.337485:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683429.337514:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff574 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0282 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.337639:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.337655:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.337668:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683429.337696:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789683429.337789:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.337797:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.337805:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.337996:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683429.338001:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.338010:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.338022:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9300) 00010000:00010000:2.0:1789683429.338026:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683429.338031:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.338047:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff57b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.338087:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff574 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0282 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.338098:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:2.0:1789683429.338100:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683429.338104:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff574 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0282 expref: 33 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.338113:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909800, rc 0) 00000100:00100000:2.0:1789683429.338182:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76129180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11500:x1876618802967296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 730us (5262us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1789683429.338190:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 172 00000100:00100000:2.0:1789683429.342939:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683429.343228:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802967424 00000100:00100000:3.0:1789683429.343239:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802967424 00000100:00100000:3.0:1789683429.343297:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:3.0:1789683429.343308:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11500:x1876618802967424:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789683429.343344:0:5831:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789683429.343452:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48a5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11500:x1876618802967424:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 146us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.343459:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 173 00000100:00100000:2.0:1789683429.351311:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683429.352937:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802967680 00000100:00100000:3.0:1789683429.352950:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802967680 00000100:00100000:3.0:1789683429.353016:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:3.0:1789683429.353039:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11500:x1876618802967680:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683429.353062:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683429.353065:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789683429.353090:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0274 expref: 32 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.353109:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:3.0:1789683429.353113:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683429.353126:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff589 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0289 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683429.353996:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1789683429.362903:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff590 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.362924:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.362937:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff590 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.363035:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8400/0x59bee33f93ff589 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0289 expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.363054:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff590 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0289 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.363072:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9e00) 00010000:00010000:1.0:1789683429.363075:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683429.363079:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7200, rc 0) 00000100:00100000:1.0:1789683429.363147:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:11500:x1876618802967680:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 10109us (11846us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1789683429.363155:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 174 00000100:00100000:3.0:1789683429.375556:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683429.376214:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802967936 00000100:00100000:0.0:1789683429.376225:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802967936 00000100:00100000:0.0:1789683429.376288:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 175 00000100:00100000:0.0:1789683429.376309:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:11500:x1876618802967936:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789683429.376366:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683429.376502:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff590 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0289 expref: 33 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.376542:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9e00) 00010000:00010000:0.0:1789683429.376554:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683429.376577:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.376590:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.376599:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.376613:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.376620:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.376626:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380606:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380623:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380631:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380637:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683429.380642:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380657:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380693:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683429.380696:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683429.380702:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380708:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff59e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380721:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380728:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380733:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380737:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683429.380740:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380747:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380753:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xbd731af4 (ffff8dbe60aa2000) 00010000:00010000:0.0:1789683429.380756:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683429.380759:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.380776:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xbd731af4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683429.380991:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c162680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11500:x1876618802967936:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 4687us (5436us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683429.381001:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 175 00000100:00100000:2.0:1789683429.390442:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683429.393834:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802968064 00000100:00100000:1.0:1789683429.393850:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802968064 00000100:00100000:1.0:1789683429.393924:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 176 00000100:00100000:1.0:1789683429.393934:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11500:x1876618802968064:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683429.393957:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683429.393980:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff5ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0290 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.394014:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.394028:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.394039:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.394137:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff5ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0290 expref: 34 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.394159:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0290 expref: 33 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.394168:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:1.0:1789683429.394171:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789683429.394174:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7600, rc 0) 00000100:00100000:1.0:1789683429.394236:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c118e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:11500:x1876618802968064:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 304us (3803us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683429.394243:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 176 00000100:00100000:2.0:1789683429.407108:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683429.407578:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802968320 00000100:00100000:0.0:1789683429.407590:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802968320 00000100:00100000:0.0:1789683429.407651:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00100000:0.0:1789683429.407661:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+33:11500:x1876618802968320:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789683429.407773:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.407791:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.407803:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683429.408167:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1789683429.408178:0:5829:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363039504284ns, next at 364039501864ns, rc = 0 00000004:00010000:0.0:1789683429.408268:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffc7a5ce reply state 00000000e620e698 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683429.408277:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683429.408510:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:11500:x1876618802968320:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 849us (1410us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1789683429.408518:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 177 00000100:00100000:0.0:1789683429.413250:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683429.413986:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802968448 00000100:00100000:3.0:1789683429.413997:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802968448 00000100:00100000:3.0:1789683429.414058:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:3.0:1789683429.414068:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:11500:x1876618802968448:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683429.414091:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683429.414110:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0297 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.414179:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0297 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.414194:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0297 expref: 36 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.414234:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:3.0:1789683429.414237:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683429.414241:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8600, rc 0) 00010000:00010000:1.0:1789683429.415448:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.415461:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.415468:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.415474:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40e200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683429.415480:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.417325:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.417345:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:1.0:1789683429.417348:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789683429.417355:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.417378:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e200/0x59bee33f93ff5ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683429.418262:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11500:x1876618802968448:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 229us (1053us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.418282:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 178 00000100:00100000:2.0:1789683429.418361:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683429.418439:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802968576 00000100:00100000:1.0:1789683429.418448:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802968576 00000100:00080000:2.0:1789683429.418774:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683429.418780:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:1.0:1789683429.418791:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802968576:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789683429.419219:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802968576:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 429us (856us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789683429.419226:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:3.0:1789683429.427851:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683429.430701:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802968832 00000100:00100000:1.0:1789683429.430716:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802968832 00000100:00100000:1.0:1789683429.430780:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:1.0:1789683429.430791:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:11500:x1876618802968832:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789683429.431033:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11500:x1876618802968832:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 243us (3189us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789683429.431041:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:2.0:1789683429.436528:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683429.437448:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802969088 00000100:00100000:1.0:1789683429.437469:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802969088 00000100:00100000:1.0:1789683429.437530:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:1.0:1789683429.437541:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11500:x1876618802969088:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789683429.437655:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11500:x1876618802969088:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 115us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683429.437663:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 179 00000100:00100000:3.0:1789683429.442132:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683429.443406:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802969216 00000100:00100000:2.0:1789683429.443422:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802969216 00000100:00100000:2.0:1789683429.443507:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 180 00000100:00100000:2.0:1789683429.443518:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11500:x1876618802969216:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683429.443554:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683429.443573:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff5c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f029e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.443642:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff5cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.443656:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.443667:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683429.443723:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683429.443742:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.443767:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff5c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f029e expref: 38 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.443784:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff5cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f029e expref: 37 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.443791:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:2.0:1789683429.443794:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789683429.443798:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908800, rc 0) 00000100:00100000:2.0:1789683429.443872:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:11500:x1876618802969216:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 356us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683429.443879:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 180 00000100:00100000:3.0:1789683429.447825:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683429.449379:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802969344 00000100:00100000:0.0:1789683429.449390:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802969344 00000100:00100000:0.0:1789683429.449466:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:0.0:1789683429.449475:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802969344:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683429.449492:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683429.449511:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02a5 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789683429.449534:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac66e5, blocks: 0x1 00010000:00010000:0.0:1789683429.449552:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:0.0:1789683429.449556:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683429.449565:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02a5 expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.449582:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02a5 expref: 8 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.449595:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f200, rc 0) 00000100:00100000:0.0:1789683429.449650:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802969344:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 176us (1844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683429.449657:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:2.0:1789683429.461628:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683429.461910:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802969600 00000100:00100000:1.0:1789683429.461920:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802969600 00000100:00100000:1.0:1789683429.461977:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:1.0:1789683429.461987:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:11500:x1876618802969600:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789683429.462100:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:11500:x1876618802969600:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 114us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683429.462107:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 181 00000100:00100000:0.0:1789683429.467846:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683429.468085:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802969728 00000100:00100000:1.0:1789683429.468094:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802969728 00000100:00100000:1.0:1789683429.468153:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:1.0:1789683429.468162:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:11500:x1876618802969728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789683429.468181:0:6676:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683429.468200:0:6676:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02ac expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.468233:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02a5 expref: 9 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.468243:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683429.468247:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683429.468252:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.468283:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02a5 expref: 9 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.468304:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02a5 expref: 9 pid: 6674 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683429.468326:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6676:1876618815551232:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683429.468420:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbd45413d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683429.477279:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6676:1876618815551232:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683429.477321:0:6676:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 9 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.477345:0:6676:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6c00, rc 0) 00000100:00100000:0.0:1789683429.477494:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:11500:x1876618802969728:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 9331us (9655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683429.477518:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:2.0:1789683429.483291:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683429.483396:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802969856 00000100:00100000:2.0:1789683429.483406:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802969856 00010000:00010000:2.0:1789683429.483447:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02a5 expref: 9 pid: 6674 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683429.483494:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1789683429.483506:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2353:x1876618802969856:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683429.483520:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683429.483816:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02a5 expref: 9 pid: 6674 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.483831:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02a5 expref: 9 pid: 6674 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.483870:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff5d6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02a5 expref: 9 pid: 6674 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.483888:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683429.483892:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683429.483902:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.483913:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.483966:0:5814:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683429.483982:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f35c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5814:1876618815551360:192.168.203.60@tcp:105: 00000100:00100000:2.0:1789683429.484248:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe49664900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683429.493490:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683429.494725:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802969984 00000100:00100000:3.0:1789683429.494738:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802969984 00002000:00100000:3.0:1789683429.494790:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8dbe76f35180 x1876618802969984/t0(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:485/0 lens 504/0 e 0 to 0 dl 1789683440 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683429.494802:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe76f35180 with x1876618802969984 ext(0->8) 00002000:00010000:3.0:1789683429.494807:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe76f35180 00000100:00100000:3.0:1789683429.494866:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1789683429.494877:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2352:x1876618802969984:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789683429.495315:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:2352:x1876618802969984:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 437us (1840us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789683429.495323:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00002000:00100000:3.0:1789683429.495330:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8dbe76f35180 x1876618802969984/t4294967314(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:485/0 lens 504/448 e 0 to 0 dl 1789683440 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789683429.495339:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe76f35180 with x1876618802969984 ext(0->8) 00002000:00010000:3.0:1789683429.495349:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe76f35180 00000100:00100000:1.0:1789683429.498462:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f35c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5814:1876618815551360:192.168.203.60@tcp:105: 00010000:00010000:1.0:1789683429.498492:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683429.499533:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2353:x1876618802969856:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 16024us (16247us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683429.499546:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:2.0:1789683429.500061:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683429.500184:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802970112 00000100:00100000:2.0:1789683429.500191:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802970112 00000100:00100000:2.0:1789683429.500235:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 182 00000100:00100000:2.0:1789683429.500245:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:11500:x1876618802970112:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789683429.584346:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:11500:x1876618802970112:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 84092us (84276us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.584360:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 182 00000001:00080000:3.0:1789683429.584401:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:3.0:1789683429.584407:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:2.0:1789683429.597456:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683429.597476:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815551488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789683429.597540:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683429.597630:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815551488 00000100:00100000:2.0:1789683429.597638:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815551488 00000100:00100000:2.0:1789683429.597710:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789683429.597719:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815551488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789683429.597893:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789683429.597898:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789683429 00002000:00010000:2.0:1789683429.597900:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789683429.597902:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789683429 -> 1789683429 00002000:00010000:2.0:1789683429.597905:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789683429.597945:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815551488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (403us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1789683429.597966:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1789683429.597988:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789683429.598021:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe76f37800/2, rc 0, transno 4294967315 00000100:00100000:2.0:1789683429.598027:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815551488:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789683429.598445:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:3.0:1789683429.598484:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:3.0:1789683429.601911:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789683429.601928:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789683429.601990:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683429.606533:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802970240 00000100:00100000:3.0:1789683429.606548:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802970240 00000100:00100000:3.0:1789683429.606730:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:3.0:1789683429.606742:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2352:x1876618802970240:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789683429.688336:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2352:x1876618802970240:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 81587us (86340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683429.688350:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000001:00080000:2.0:1789683429.688427:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1789683429.688441:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1789683429.688447:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1789683429.691940:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683429.692262:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802970496 00000100:00100000:2.0:1789683429.692273:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802970496 00000100:00100000:2.0:1789683429.692335:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 183 00000100:00100000:2.0:1789683429.692346:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:11500:x1876618802970496:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683429.692401:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683429.692430:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff5cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f029e expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.692449:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:2.0:1789683429.692455:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683429.692642:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.692659:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.692701:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683429.693030:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007e0fdb59 reply state 000000005629ba56 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683429.693056:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683429.693224:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11500:x1876618802970496:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 878us (1289us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789683429.693231:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 183 00000100:00100000:2.0:1789683429.696737:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00010000:00010000:0.0:1789683429.697263:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.697278:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.697286:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.697292:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683429.697298:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.697306:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.697323:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:0.0:1789683429.697327:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683429.697332:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.697339:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff5e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683429.697474:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802970624 00000100:00100000:3.0:1789683429.697484:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802970624 00000100:00100000:3.0:1789683429.697579:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:3.0:1789683429.697590:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802970624:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789683429.697879:0:6674:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789683429.697884:0:6674:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789683429 -> 1789683428 00002000:00010000:3.0:1789683429.697886:0:6674:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789683426 00002000:00010000:3.0:1789683429.697888:0:6674:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789683429 -> 1789683428 00002000:00010000:3.0:1789683429.697891:0:6674:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789683429.697949:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802970624:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 361us (1221us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789683429.697956:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:0.0:1789683429.700797:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683429.700955:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802970880 00000100:00100000:1.0:1789683429.700966:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802970880 00000100:00100000:1.0:1789683429.701064:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:1.0:1789683429.701075:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:11500:x1876618802970880:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789683429.701236:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.701253:0:9827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0290 expref: 18 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.701261:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.701297:0:9827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0290 expref: 18 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683429.701330:0:9827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0290 expref: 18 pid: 6698 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683429.701344:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815551616:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683429.701468:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48c8e180 going to sleep for 11 seconds 00000100:00100000:0.0:1789683429.705701:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683429.706287:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815551616:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683429.706316:0:9827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683429.706396:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802971008 00000100:00100000:3.0:1789683429.706404:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802971008 00010000:00010000:3.0:1789683429.706441:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0290 expref: 19 pid: 6698 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683429.706580:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:3.0:1789683429.706591:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:2352:x1876618802971008:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683429.706606:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683429.706613:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0290 expref: 19 pid: 6698 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.706625:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0290 expref: 19 pid: 6698 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.706646:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff5b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0290 expref: 19 pid: 6698 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.706663:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:3.0:1789683429.706668:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.706708:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.706715:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.706740:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683429.706800:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:2352:x1876618802971008:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 211us (1134us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.706829:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00010000:00010000:0.0:1789683429.707702:0:9827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.707725:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.707756:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.707762:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.707768:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.707774:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683429.707778:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.707786:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.707796:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:0.0:1789683429.707799:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789683429.707803:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.707819:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff5eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683429.707887:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:11500:x1876618802970880:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 6811us (7096us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789683429.707895:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:0.0:1789683429.710928:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683429.711035:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802971136 00000100:00100000:2.0:1789683429.711045:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802971136 00000100:00100000:2.0:1789683429.711145:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1789683429.711155:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802971136:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789683429.711199:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.711220:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.711229:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683429.711232:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683429.711236:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.711287:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 8 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.711302:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 8 pid: 6676 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683429.711329:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6676:1876618815551744:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683429.711409:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5309f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683429.713518:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6676:1876618815551744:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683429.713544:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683429.715554:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683429.716062:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802971264 00000100:00100000:2.0:1789683429.716072:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802971264 00010000:00010000:2.0:1789683429.716116:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 9 pid: 6676 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683429.716234:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:2.0:1789683429.716245:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2353:x1876618802971264:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683429.716261:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683429.716284:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 9 pid: 6676 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.716298:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 9 pid: 6676 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.716319:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009b371b32/0x59bee33f93ff5dd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ac expref: 9 pid: 6676 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.716338:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683429.716342:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683429.716348:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.716377:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.716407:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683429.717104:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.717117:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683429.717394:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802971264:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1147us (1844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683429.717403:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00010000:00010000:3.0:1789683429.717465:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.717475:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.717483:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.717490:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683429.717494:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.717503:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.717517:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.717542:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff5f2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683429.717612:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802971136:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 6459us (6693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.717620:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1789683429.721725:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683429.722493:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802971520 00000100:00100000:3.0:1789683429.722504:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802971520 00000100:00100000:3.0:1789683429.722556:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:3.0:1789683429.722566:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+17:11500:x1876618802971520:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789683429.722644:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.722660:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.722699:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.723059:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.723071:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0297 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.723079:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.723272:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0297 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.723286:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0297 expref: 18 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683429.723302:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815551872:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683429.723499:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb900 going to sleep for 11 seconds 00000100:00100000:2.0:1789683429.726606:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815551872:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683429.726634:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683429.727037:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683429.727112:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802971648 00000100:00100000:2.0:1789683429.727120:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802971648 00010000:00010000:2.0:1789683429.727155:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0297 expref: 19 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683429.727198:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 72 00000100:00100000:2.0:1789683429.727208:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:2352:x1876618802971648:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683429.727222:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683429.727230:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0297 expref: 19 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.727242:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0297 expref: 19 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.727280:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff5c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0297 expref: 19 pid: 5831 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.727296:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:2.0:1789683429.727301:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.727309:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.727316:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.727348:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683429.727398:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:2352:x1876618802971648:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 190us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683429.727405:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 72 00010000:00010000:0.0:1789683429.728753:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.728767:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683429.728975:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1789683429.729127:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1789683429.729177:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1789683429.729259:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1876618815552000:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789683429.729322:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683429.729366:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f2b600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683429.729758:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815552000 00000100:00100000:1.0:1789683429.729766:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815552000 00000100:00100000:1.0:1789683429.729820:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683429.729830:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1876618815552000:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789683429.729927:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1876618815552000:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683429.729934:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789683429.730079:0:5829:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1789683429.730085:0:5829:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe76f37800, transno 4294967315 00000100:00100000:2.0:1789683429.730100:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1876618815552000:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789683429.730663:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789683429.730751:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c173100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1876618815552128:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789683429.730791:0:5829:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683429.730825:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5309f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683429.730843:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815552128 00000100:00100000:2.0:1789683429.730847:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815552128 00000100:00100000:2.0:1789683429.730881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683429.730895:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5829:x1876618815552128:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789683429.731047:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c172300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5829:x1876618815552128:12345-0@lo:1000:mdt00_000.0 Request processed in 152us (255us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1789683429.731053:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683429.731086:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c173100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5829:1876618815552128:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789683429.731122:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731131:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731138:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731144:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683429.731149:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731156:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731171:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe46df9400) 00010000:00010000:2.0:1789683429.731174:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683429.731179:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731185:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff600 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731216:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731228:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731234:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731239:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683429.731243:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731249:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731257:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9300) 00010000:00010000:2.0:1789683429.731260:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683429.731263:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731269:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff53c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731290:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731303:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f027b expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731312:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731334:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f027b expref: 21 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.731356:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f027b expref: 21 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683429.731367:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c170000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815552256:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683429.731430:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e93bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683429.736259:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683429.736375:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c170000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815552256:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683429.736403:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683429.736450:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802971776 00000100:00100000:3.0:1789683429.736457:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802971776 00010000:00010000:3.0:1789683429.736548:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f027b expref: 22 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683429.736787:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:3.0:1789683429.736798:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:2352:x1876618802971776:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683429.736890:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683429.736898:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f027b expref: 22 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.736911:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f027b expref: 22 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.736930:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff558 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f027b expref: 22 pid: 5830 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.736948:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9300) 00010000:00010000:3.0:1789683429.736953:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.736976:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.736984:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683429.737013:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683429.737115:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737123:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737136:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737142:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737149:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737155:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683429.737160:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737168:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737186:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9300) 00010000:00010000:2.0:1789683429.737188:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683429.737193:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737199:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908200/0x59bee33f93ff607 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737211:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737218:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737224:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737229:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683429.737232:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737238:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737245:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9300) 00010000:00010000:2.0:1789683429.737248:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683429.737250:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.737257:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff5f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683429.737499:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:2352:x1876618802971776:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 701us (1248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.737508:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:2.0:1789683429.737833:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:11500:x1876618802971520:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 15267us (16115us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1789683429.737841:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 185 00000020:00080000:2.0:1789683429.737846:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789683429.737975:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683429.737979:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683429.738478:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1789683429.738500:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683429.741563:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683429.741822:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802972032 00000100:00100000:0.0:1789683429.741832:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802972032 00000100:00100000:0.0:1789683429.741896:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:0.0:1789683429.741907:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7085dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:11500:x1876618802972032:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789683429.742841:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789683429.742960:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1789683429.743010:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.743038:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.743052:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.743061:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.743068:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.743073:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683429.743094:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789683429.743184:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7085dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:11500:x1876618802972032:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1277us (1627us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1789683429.743194:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000020:00080000:0.0:1789683429.743200:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789683429.744057:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683429.744067:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.744076:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ee00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683429.744080:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.744089:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.744104:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8dbe60aa2200) 00010000:00010000:2.0:1789683429.744107:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789683429.744112:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.744119:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff60e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683429.744143:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683429.744155:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683429.744156:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683429.856181:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815552384:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683429.856252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683429.856706:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815552384 00000100:00100000:3.0:1789683429.856714:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815552384 00000100:00100000:3.0:1789683429.856771:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789683429.856781:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815552384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683429.856836:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1789683429.856922:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683429.860342:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815552384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3554us (4079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683429.860355:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789683429.860805:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815552384:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789683429.920142:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683430.944221:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683431.213374:0:12511:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683431.213386:0:12511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683431.213423:0:12511:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789683431.213429:0:12511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789683431.392886:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683431.392971:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802972288 00000100:00100000:2.0:1789683431.392982:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802972288 00000100:00100000:2.0:1789683431.393057:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 186 00000100:00100000:2.0:1789683431.393067:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:11518:x1876618802972288:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683431.393090:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683431.393111:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908400/0x59bee33f93ff615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02b3 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.393216:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93ff61c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.393232:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93ff61c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.393245:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93ff61c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683431.393257:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789683431.393392:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908400/0x59bee33f93ff615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02b3 expref: 25 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.393410:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93ff61c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02b3 expref: 24 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.393436:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:2.0:1789683431.393439:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683431.393443:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908600, rc 0) 00000100:00100000:2.0:1789683431.393505:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:11518:x1876618802972288:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 439us (629us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1789683431.393512:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 186 00000100:00080000:0.0:1789683431.393955:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683431.395883:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.396709:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802972416 00000100:00100000:0.0:1789683431.396722:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802972416 00000100:00100000:0.0:1789683431.396783:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 187 00000100:00100000:0.0:1789683431.396794:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:11518:x1876618802972416:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1789683431.396885:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.396916:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.396931:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.396951:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.396959:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.396965:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.406954:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.406976:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.407002:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683431.407054:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.407069:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.407075:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.407083:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.407090:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fc00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683431.407094:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.407102:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.407114:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683431.407117:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683431.407122:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.407129:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff62a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.407140:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408466:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408476:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408482:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683431.408486:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408494:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408507:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe60aa2500) 00010000:00010000:1.0:1789683431.408510:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683431.408515:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408521:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408549:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408556:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408561:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408566:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683431.408583:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408589:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408598:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9b00) 00010000:00010000:1.0:1789683431.408600:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683431.408603:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.408609:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff638 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683431.408720:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:11518:x1876618802972416:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 11923us (12842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683431.408729:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 187 00000100:00100000:1.0:1789683431.493999:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683431.494365:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802972672 00000100:00100000:2.0:1789683431.494376:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802972672 00000100:00100000:2.0:1789683431.494439:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:2.0:1789683431.494450:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+24:11521:x1876618802972672:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683431.494473:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683431.494504:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908400/0x59bee33f93ff63f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02ba expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495192:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495209:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495220:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495235:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495242:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495262:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495550:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495700:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495708:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683431.495721:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1789683431.495898:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495906:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495914:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495921:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683431.495926:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495934:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495947:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:2.0:1789683431.495951:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683431.495962:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495969:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff646 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495982:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495989:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.495995:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.496000:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683431.496003:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.496009:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.496016:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683431.496019:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683431.496022:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.496028:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff64d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.496070:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908400/0x59bee33f93ff63f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ba expref: 27 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.496095:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ba expref: 26 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.496102:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:2.0:1789683431.496105:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683431.496108:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908e00, rc 0) 00000100:00100000:2.0:1789683431.496241:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11521:x1876618802972672:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1791us (2254us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1789683431.496250:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 188 00000100:00100000:0.0:1789683431.502511:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683431.502908:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802972800 00000100:00100000:3.0:1789683431.502920:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802972800 00000100:00100000:3.0:1789683431.503022:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:3.0:1789683431.503033:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11521:x1876618802972800:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:3.0:1789683431.503097:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.503115:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.503144:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.503172:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.503180:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.503187:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.503193:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683431.503198:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.503205:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.503216:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:3.0:1789683431.503219:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683431.503224:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.503230:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff662 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683431.503312:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11521:x1876618802972800:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 281us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683431.503320:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:1.0:1789683431.506400:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.506504:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802973056 00000100:00100000:0.0:1789683431.506515:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802973056 00000100:00100000:0.0:1789683431.506658:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:0.0:1789683431.506669:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11521:x1876618802973056:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683431.507105:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:11521:x1876618802973056:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 435us (711us total) trans 4294967471 rc 0/0 00000100:00100000:0.0:1789683431.507112:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1789683431.553659:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683431.556651:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802973312 00000100:00100000:1.0:1789683431.556667:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802973312 00000100:00100000:1.0:1789683431.557064:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:1.0:1789683431.557076:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:11047:x1876618802973312:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1789683431.557103:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683431.557122:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff669 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02c1 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.557216:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.557250:0:9827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ba expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.557259:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.557298:0:9827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ba expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.557312:0:9827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ba expref: 28 pid: 5829 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683431.557337:0:9827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815552512:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683431.557442:0:9827:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48c8e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683431.564089:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683431.564205:0:9827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9827:1876618815552512:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683431.564235:0:9827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683431.567973:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802973440 00000100:00100000:2.0:1789683431.567989:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802973440 00010000:00010000:2.0:1789683431.568042:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ba expref: 29 pid: 5829 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683431.568145:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1789683431.568157:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:2352:x1876618802973440:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683431.568174:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683431.568181:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ba expref: 29 pid: 5829 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.568194:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ba expref: 29 pid: 5829 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.568216:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02ba expref: 29 pid: 5829 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.568255:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:2.0:1789683431.568261:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.568271:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.568280:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683431.568320:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683431.568433:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:2352:x1876618802973440:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 277us (4354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683431.568442:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00010000:00010000:3.0:1789683431.570210:0:9827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.570240:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683431.570263:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789683431.570421:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff669 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c1 expref: 29 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.570444:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c1 expref: 28 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.570453:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:3.0:1789683431.570457:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789683431.570461:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6400, rc 0) 00000100:00100000:3.0:1789683431.570518:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c173480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:11047:x1876618802973312:12345-192.168.203.60@tcp:101:bash.0 Request processed in 13444us (16869us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1789683431.570526:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:0.0:1789683431.582586:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683431.583807:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802973696 00000100:00100000:3.0:1789683431.583821:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802973696 00000100:00100000:3.0:1789683431.583905:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 191 00000100:00100000:3.0:1789683431.583915:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:11047:x1876618802973696:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:3.0:1789683431.584188:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.584207:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.584220:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683431.584289:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1789683431.584314:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004be713a0 reply state 00000000f60d897f transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683431.584324:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789683431.584370:0:5829:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1789683431.584472:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11047:x1876618802973696:12345-192.168.203.60@tcp:36:bash.0 Request processed in 557us (1894us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1789683431.584480:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 191 00000020:00080000:3.0:1789683431.584485:0:5829:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1789683431.592459:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.592506:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.592543:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.592598:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.592731:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802973824 00000100:00100000:0.0:1789683431.592741:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802973824 00000100:00100000:0.0:1789683431.592791:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 305 00000100:00100000:0.0:1789683431.592801:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802973824:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683431.592881:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:85ca73fa-7ddf-4820-b817-0961de675c61+13:2354:x1876618802973824:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 80us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683431.592889:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 305 00000100:00100000:0.0:1789683431.592924:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802973952 00000100:00100000:0.0:1789683431.592927:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802973952 00000100:00100000:0.0:1789683431.592963:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802974080 00000100:00100000:0.0:1789683431.592966:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802974080 00000100:00100000:0.0:1789683431.592987:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:0.0:1789683431.592993:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802973952:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683431.592997:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802974208 00000100:00100000:3.0:1789683431.593000:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802974208 00000100:00100000:0.0:1789683431.593022:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2354:x1876618802973952:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683431.593028:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 176 00000100:00100000:0.0:1789683431.593029:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:3.0:1789683431.593034:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802974208:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683431.593039:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:0.0:1789683431.593044:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2354:x1876618802974080:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683431.593064:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2354:x1876618802974208:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683431.593064:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2354:x1876618802974080:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 19us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683431.593071:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 176 00000100:00100000:0.0:1789683431.593071:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00010000:00010000:0.0:1789683431.593091:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.593102:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.593117:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.593123:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683431.593128:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.593136:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.593153:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:0.0:1789683431.593156:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683431.593161:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.593168:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff67e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789683431.593200:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683431.593205:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683431.593207:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683431.593235:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683431.593319:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802974336 00000100:00100000:3.0:1789683431.593324:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802974336 00000100:00100000:3.0:1789683431.593350:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 192 00000100:00100000:0.0:1789683431.593453:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11047:x1876618802974336:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683431.593467:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683431.593483:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02c8 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.593538:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c8 expref: 32 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.593563:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c8 expref: 32 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.593582:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:0.0:1789683431.593584:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683431.593587:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f200, rc 0) 00000100:00100000:0.0:1789683431.593623:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11047:x1876618802974336:12345-192.168.203.60@tcp:101:bash.0 Request processed in 266us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683431.593629:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 192 00000100:00100000:0.0:1789683431.596283:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683431.596368:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802974464 00000100:00100000:3.0:1789683431.596378:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802974464 00000100:00100000:3.0:1789683431.596438:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:3.0:1789683431.596449:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:11047:x1876618802974464:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683431.596467:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683431.596489:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02cf expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683431.596537:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aac66e4, atime: 0x6aac66e2, ctime: 0x6aac66e4, blocks: 0xb 00010000:00010000:3.0:1789683431.596570:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:3.0:1789683431.596575:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683431.596583:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02cf expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.596602:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02cf expref: 8 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.596614:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9600, rc 0) 00000100:00100000:3.0:1789683431.596717:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:11047:x1876618802974464:12345-192.168.203.60@tcp:101:bash.0 Request processed in 270us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683431.596725:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:2.0:1789683431.601803:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683431.601909:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802974592 00000100:00100000:3.0:1789683431.601920:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802974592 00002000:00010000:3.0:1789683431.601965:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789683431.601969:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe7c173800 with x1876618802974592 ext(0->18446744073709551615) 00002000:00010000:3.0:1789683431.601981:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe7c173800. 00000100:00100000:3.0:1789683431.602019:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:3.0:1789683431.602029:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802974592:12345-192.168.203.60@tcp:10:bash.0 00002000:00010000:3.0:1789683431.602329:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789683431.602334:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789683428 -> 1789683431 00002000:00010000:3.0:1789683431.602336:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789683426 -> 1789683426 00002000:00010000:3.0:1789683431.602339:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789683428 -> 1789683431 00002000:00010000:3.0:1789683431.602356:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789683431.602440:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c173800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2352:x1876618802974592:12345-192.168.203.60@tcp:10:bash.0 Request processed in 411us (645us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789683431.602450:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00002000:00010000:3.0:1789683431.602454:0:6681:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789683431.602457:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe7c173800 with x1876618802974592 ext(0->18446744073709551615) 00002000:00010000:3.0:1789683431.602462:0:6681:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe7c173800. 00000100:00100000:1.0:1789683431.693209:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.693309:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802974720 00000100:00100000:0.0:1789683431.693319:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802974720 00000100:00100000:0.0:1789683431.693382:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:0.0:1789683431.693394:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11535:x1876618802974720:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:0.0:1789683431.693474:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693492:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693504:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693521:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693530:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693555:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693811:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693821:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693829:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683431.693875:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693887:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693894:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693901:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693908:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fc00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683431.693912:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693919:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693931:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683431.693939:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683431.693945:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693951:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40fc00/0x59bee33f93ff693 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693963:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693969:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693976:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693981:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ee00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683431.693984:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693990:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.693996:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe60aa2800) 00010000:00010000:0.0:1789683431.693999:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683431.694001:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.694007:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff69a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.694021:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.694032:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.694039:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.694044:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683431.694047:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.694053:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.694060:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:0.0:1789683431.694062:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683431.694065:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.694070:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683431.694151:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11535:x1876618802974720:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 758us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683431.694159:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 193 00000100:00100000:1.0:1789683431.764407:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683431.764494:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802974976 00000100:00100000:3.0:1789683431.764506:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802974976 00000100:00100000:3.0:1789683431.764573:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:3.0:1789683431.764583:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+32:11538:x1876618802974976:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683431.764605:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683431.764628:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff6a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02d6 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.764733:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.764750:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.764762:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.764779:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.764786:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.764822:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765100:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff6bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765111:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765118:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff6bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683431.765128:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789683431.765231:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765239:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765245:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765250:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683431.765255:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765263:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765274:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:3.0:1789683431.765277:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683431.765288:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765294:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff6af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765307:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765313:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765319:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765323:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683431.765326:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765332:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765339:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe5931e300) 00010000:00010000:3.0:1789683431.765341:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683431.765344:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765350:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8200/0x59bee33f93ff6b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765389:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8a00/0x59bee33f93ff6a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02d6 expref: 35 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765414:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff6bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02d6 expref: 34 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.765421:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:3.0:1789683431.765423:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789683431.765426:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8600, rc 0) 00000100:00100000:3.0:1789683431.765665:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:11538:x1876618802974976:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1081us (1266us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789683431.765771:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:2.0:1789683431.777102:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.777183:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802975104 00000100:00100000:0.0:1789683431.777193:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802975104 00000100:00100000:0.0:1789683431.777254:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:0.0:1789683431.777266:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+34:11538:x1876618802975104:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:0.0:1789683431.777338:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.777366:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c1 expref: 34 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.777376:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.777409:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c1 expref: 34 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.777423:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c1 expref: 34 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683431.777436:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815552640:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683431.777533:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f2b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683431.788458:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815552640:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683431.788496:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683431.790007:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.791947:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802975360 00000100:00100000:0.0:1789683431.791966:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802975360 00000100:00100000:0.0:1789683431.792040:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:0.0:1789683431.792051:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:5586:x1876618802975360:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000001:00080000:0.0:1789683431.792362:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967477 00000100:00100000:0.0:1789683431.792493:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:5586:x1876618802975360:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 443us (2493us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1789683431.792502:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000020:00080000:0.0:1789683431.792520:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789683431.801339:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683431.801428:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802975488 00000100:00100000:3.0:1789683431.801439:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802975488 00010000:00010000:3.0:1789683431.801477:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c1 expref: 37 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683431.801529:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1789683431.801539:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:2353:x1876618802975488:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683431.801562:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683431.801569:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c1 expref: 37 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.801584:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c1 expref: 37 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.801607:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff670 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c1 expref: 37 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.801642:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:3.0:1789683431.801647:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.801656:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.801665:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683431.801751:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683431.801948:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.801957:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.801994:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.802009:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.802016:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.802023:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683431.802028:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.802038:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.802047:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:1.0:1789683431.802050:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683431.802054:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.802061:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff6cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683431.802110:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11538:x1876618802975104:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 24845us (25016us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683431.802118:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 195 00000100:00100000:3.0:1789683431.802772:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:2353:x1876618802975488:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1231us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683431.802781:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:1.0:1789683431.810608:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683431.810711:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802975744 00000100:00100000:0.0:1789683431.810722:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802975744 00000100:00100000:0.0:1789683431.810775:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:0.0:1789683431.810785:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+35:11538:x1876618802975744:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683431.811048:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11538:x1876618802975744:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 263us (448us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1789683431.811056:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:0.0:1789683431.907425:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815553024:0@lo:400:kworker.0 00000100:00100000:0.0:1789683431.907497:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683431.907562:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789683431.907568:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815553152:0@lo:400:kworker.0 00000100:00100000:0.0:1789683431.907606:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683431.907638:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815553152 00000100:00100000:0.0:1789683431.907645:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815553152 00000100:00100000:0.0:1789683431.907726:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789683431.907736:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1876618815553152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908001:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815552896:0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908031:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683431.908051:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815553408:0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908070:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683431.908107:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789683431.908113:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815552768:0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908137:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683431.908154:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815553280:0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908171:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683431.908195:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815553408 00000100:00100000:1.0:1789683431.908198:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815553408 00000100:00100000:1.0:1789683431.908224:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789683431.908231:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815553408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908268:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815553408:12345-0@lo:400:kworker.0 Request processed in 37us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683431.908275:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789683431.908318:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815553408:0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908345:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815553024 00000100:00100000:1.0:1789683431.908349:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815553024 00000100:00100000:1.0:1789683431.908374:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815552896 00000100:00100000:1.0:1789683431.908377:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815552896 00000100:00100000:1.0:1789683431.908390:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815553280 00000100:00100000:1.0:1789683431.908400:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815553280 00000100:00100000:1.0:1789683431.908415:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789683431.908421:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815553024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908453:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815553024:12345-0@lo:400:kworker.0 Request processed in 32us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683431.908459:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789683431.908470:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789683431.908476:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815552896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908503:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815552896:12345-0@lo:400:kworker.0 Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683431.908516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1789683431.908528:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789683431.908534:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815553280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908562:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815553280:12345-0@lo:400:kworker.0 Request processed in 29us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683431.908568:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789683431.908606:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815553280:0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908615:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815552896:0@lo:400:kworker.0 00000100:00080000:1.0:1789683431.908660:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789683431.908665:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683431.908667:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683431.908710:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815553152:0@lo:400:kworker.0 00000100:00100000:1.0:1789683431.908721:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815553024:0@lo:400:kworker.0 00000100:00100000:0.0:1789683431.908998:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1876618815553152:12345-0@lo:400:kworker.0 Request processed in 1263us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683431.909005:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789683431.910661:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815552768 00000100:00100000:2.0:1789683431.910696:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815552768 00000100:00100000:2.0:1789683431.910767:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1789683431.910777:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815552768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683431.911078:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:08ddc492-5684-492d-ac6b-b8fd660301db+19:3305:x1876618815552768:12345-0@lo:400:kworker.0 Request processed in 301us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683431.911085:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1789683431.912741:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:08ddc492-5684-492d-ac6b-b8fd660301db:3305:1876618815552768:0@lo:400:kworker.0 00000100:00100000:3.0:1789683431.915054:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683431.915080:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683431.915100:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815553536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683431.915152:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683431.916747:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802976000 00000100:00100000:1.0:1789683431.916759:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802976000 00000100:00100000:1.0:1789683431.916833:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 196 00000100:00100000:1.0:1789683431.916853:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+36:11549:x1876618802976000:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:1.0:1789683431.916885:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683431.916912:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02dd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.916993:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.917024:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.917036:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.917053:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.917059:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.917066:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683431.917403:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815553536 00000100:00100000:0.0:1789683431.917409:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815553536 00000100:00100000:0.0:1789683431.917441:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789683431.917450:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815553536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683431.917480:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00010000:00010000:1.0:1789683431.919667:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff6e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919697:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919708:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff6e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683431.919720:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789683431.919814:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919822:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919830:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919857:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683431.919861:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919869:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919882:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683431.919885:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683431.919891:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919898:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff6d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919912:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919918:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919924:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919929:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683431.919932:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919937:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919952:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe46df9b00) 00010000:00010000:1.0:1789683431.919955:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683431.919958:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.919963:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.920013:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02dd expref: 39 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.920025:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff6e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02dd expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.920032:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:1.0:1789683431.920035:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683431.920037:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6200, rc 0) 00000100:00100000:1.0:1789683431.920096:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+38:11549:x1876618802976000:12345-192.168.203.60@tcp:101:cat.0 Request processed in 3245us (5049us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789683431.920103:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 196 00000100:00100000:3.0:1789683431.920509:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76d01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815553536:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683431.920647:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815553536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1344us (3639us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683431.920667:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789683431.925487:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683431.925613:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802976256 00000100:00100000:1.0:1789683431.925623:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802976256 00000100:00100000:1.0:1789683431.925696:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:1.0:1789683431.925706:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+38:11549:x1876618802976256:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:1.0:1789683431.925947:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+39:11549:x1876618802976256:12345-192.168.203.60@tcp:35:cat.0 Request processed in 241us (469us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789683431.925954:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 54 00000100:00100000:2.0:1789683431.963202:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683431.964229:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802976512 00000100:00100000:1.0:1789683431.964243:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802976512 00000100:00100000:1.0:1789683431.964301:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 197 00000100:00100000:1.0:1789683431.964312:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+39:11550:x1876618802976512:12345-192.168.203.60@tcp:36:rm.0 00010000:00010000:1.0:1789683431.964367:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1789683431.964395:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff6e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02dd expref: 39 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.964421:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea8600/0x59bee33f93ff6bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02d6 expref: 38 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.964436:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02c8 expref: 37 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.964447:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe6097ca00) 00010000:00010000:1.0:1789683431.964458:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683431.964480:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.964494:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.964504:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.964531:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.964539:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.964567:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.966006:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.966021:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.966030:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683431.966554:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1789683431.966564:0:5830:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 365597891029ns, next at 366597888747ns, rc = 0 00000001:00080000:2.0:1789683431.967100:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00010000:00010000:2.0:1789683431.967918:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683431.969208:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969233:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969245:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969255:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969263:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969269:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969289:0:5830:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683431.969311:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969318:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969325:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969331:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683431.969336:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969361:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969373:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9600) 00010000:00010000:0.0:1789683431.969376:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789683431.969381:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969387:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff703 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969409:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969415:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969420:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969425:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683431.969428:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969433:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969441:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683431.969444:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683431.969447:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.969463:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff6f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683431.969475:0:5830:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002268f8a4 reply state 00000000cbd0692d transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683431.969485:0:5830:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789683431.969706:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683431.969712:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.969719:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ee00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683431.969722:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.969729:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.969738:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8dbe46df9600) 00010000:00010000:1.0:1789683431.969741:0:5817:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789683431.969744:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.969749:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff70a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683431.969776:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683431.969778:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683431.969780:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683431.971730:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c171180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+38:11550:x1876618802976512:12345-192.168.203.60@tcp:36:rm.0 Request processed in 5274us (6392us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789683431.971743:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 197 00010000:00010000:0.0:1789683431.972822:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.972846:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.972855:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.972861:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683431.972866:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.972874:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.972890:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe46df9b00) 00010000:00010000:0.0:1789683431.972893:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683431.972897:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683431.972924:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff6fc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.043630:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.044052:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802976768 00000100:00100000:1.0:1789683432.044064:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802976768 00000100:00100000:1.0:1789683432.044126:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 198 00000100:00100000:1.0:1789683432.044136:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+37:11556:x1876618802976768:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1789683432.044161:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683432.044183:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff711 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02e4 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.044305:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.044331:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.044342:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.044356:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.044362:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.044369:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789683432.044999:0:9827:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789683432.045152:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045162:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045170:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045200:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045206:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045211:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045216:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683432.045220:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045227:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045237:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683432.045240:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683432.045245:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045252:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff718 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683432.045275:0:9827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b176cd2 reply state 00000000be426ccf transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.045283:0:9827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789683432.045311:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff711 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02e4 expref: 40 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045324:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02e4 expref: 39 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.045331:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe46df9d00) 00010000:00010000:1.0:1789683432.045333:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683432.045335:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6000, rc 0) 00000100:00100000:1.0:1789683432.045414:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c171f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+40:11556:x1876618802976768:12345-192.168.203.60@tcp:101:bash.0 Request processed in 1279us (1805us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789683432.045422:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 198 00010000:00010000:0.0:1789683432.050844:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.050861:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.050870:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.050876:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683432.050882:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.050890:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.050907:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe46df9600) 00010000:00010000:0.0:1789683432.050910:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683432.050914:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.050920:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff71f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.053402:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.053662:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802976896 00000100:00100000:1.0:1789683432.053705:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802976896 00000100:00100000:1.0:1789683432.053760:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:1.0:1789683432.053771:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802976896:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1789683432.053801:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683432.053822:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02eb expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683432.053855:0:8465:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789683432.053875:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:1.0:1789683432.053894:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683432.053903:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02eb expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.053926:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02eb expref: 6 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.053939:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6a00, rc 0) 00000100:00100000:1.0:1789683432.053999:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c172680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2355:x1876618802976896:12345-192.168.203.60@tcp:101:bash.0 Request processed in 230us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.054007:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:3.0:1789683432.059969:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.060069:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802977024 00000100:00100000:1.0:1789683432.060079:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802977024 00000100:00100000:1.0:1789683432.060137:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:1.0:1789683432.060147:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:11556:x1876618802977024:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:1.0:1789683432.060167:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683432.060184:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02f2 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.060214:0:6674:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02eb expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.060223:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683432.060227:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683432.060232:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.060286:0:6674:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02eb expref: 7 pid: 8465 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.060300:0:6674:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02eb expref: 7 pid: 8465 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.060313:0:6674:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6674:1876618815553664:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683432.060405:0:6674:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48c8e900 going to sleep for 11 seconds 00000100:00100000:1.0:1789683432.067104:0:6674:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6674:1876618815553664:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683432.067140:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 7 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.067159:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6200, rc 0) 00000100:00100000:1.0:1789683432.067211:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:11556:x1876618802977024:12345-192.168.203.60@tcp:101:bash.0 Request processed in 7065us (7251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.067219:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:3.0:1789683432.067527:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.070411:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802977152 00000100:00100000:0.0:1789683432.070428:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802977152 00010000:00010000:0.0:1789683432.070477:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02eb expref: 7 pid: 8465 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683432.070544:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:0.0:1789683432.070567:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802977152:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683432.070582:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683432.070605:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02eb expref: 7 pid: 8465 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.070618:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02eb expref: 7 pid: 8465 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.070641:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ff734 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02eb expref: 7 pid: 8465 timeout: 465 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.070659:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683432.070663:0:11663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683432.070713:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.070726:0:11663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.070763:0:11663:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683432.070776:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11663:1876618815553792:192.168.203.60@tcp:105: 00000100:00100000:0.0:1789683432.070883:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f2b840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683432.080241:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.080411:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802977408 00000100:00100000:1.0:1789683432.080421:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802977408 00000100:00100000:1.0:1789683432.080487:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:1.0:1789683432.080497:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+39:11556:x1876618802977408:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:1.0:1789683432.080916:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+40:11556:x1876618802977408:12345-192.168.203.60@tcp:35:bash.0 Request processed in 419us (684us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789683432.080925:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 55 00000100:00100000:0.0:1789683432.081854:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:11663:1876618815553792:192.168.203.60@tcp:105: 00010000:00010000:0.0:1789683432.081880:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683432.081934:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802977152:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 11381us (14407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.081943:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1789683432.101436:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.103454:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802977536 00000100:00100000:1.0:1789683432.103469:0:6682:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802977536 00002000:00100000:1.0:1789683432.103537:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8dbe76a18a80 x1876618802977536/t0(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:488/0 lens 504/0 e 0 to 0 dl 1789683443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683432.103549:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe76a18a80 with x1876618802977536 ext(0->8) 00002000:00010000:1.0:1789683432.103555:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dbe76a18a80 00000100:00100000:1.0:1789683432.103594:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1789683432.103603:0:6682:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2354:x1876618802977536:12345-192.168.203.60@tcp:4:bash.0 00000100:00100000:1.0:1789683432.104149:0:6682:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2354:x1876618802977536:12345-192.168.203.60@tcp:4:bash.0 Request processed in 545us (2720us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1789683432.104158:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00002000:00100000:1.0:1789683432.104165:0:6682:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8dbe76a18a80 x1876618802977536/t4294967308(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:488/0 lens 504/448 e 0 to 0 dl 1789683443 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1789683432.104173:0:6682:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe76a18a80 with x1876618802977536 ext(0->8) 00002000:00010000:1.0:1789683432.104177:0:6682:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8dbe76a18a80 00000100:00100000:2.0:1789683432.119176:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.119731:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802977664 00000100:00100000:1.0:1789683432.119741:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802977664 00000100:00100000:1.0:1789683432.119807:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:1.0:1789683432.119818:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2354:x1876618802977664:12345-192.168.203.60@tcp:16:kworker.0 00000100:00100000:2.0:1789683432.197959:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2354:x1876618802977664:12345-192.168.203.60@tcp:16:kworker.0 Request processed in 78131us (78782us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.197972:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000001:00080000:3.0:1789683432.198062:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1789683432.282796:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.282935:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802977792 00000100:00100000:1.0:1789683432.282945:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802977792 00000100:00100000:1.0:1789683432.283024:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:1.0:1789683432.283035:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+40:11572:x1876618802977792:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683432.283058:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683432.283079:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff742 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f02f9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.283161:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.283176:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.283187:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683432.283219:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789683432.283224:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789683432.283240:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.283265:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff742 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f9 expref: 42 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.283283:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f9 expref: 41 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.283292:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683432.283294:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683432.283299:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7200, rc 0) 00000100:00100000:1.0:1789683432.283369:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+41:11572:x1876618802977792:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 334us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.283376:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 199 00000100:00100000:3.0:1789683432.289029:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.289227:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802978048 00000100:00100000:1.0:1789683432.289238:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802978048 00000100:00100000:1.0:1789683432.289308:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:1.0:1789683432.289319:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+41:11572:x1876618802978048:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683432.289343:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683432.289367:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff750 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0300 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.289475:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff757 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.289490:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.289503:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff757 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683432.289514:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789683432.289653:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff750 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0300 expref: 44 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.289718:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff757 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0300 expref: 43 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.289727:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe46df9d00) 00010000:00010000:1.0:1789683432.289730:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683432.289735:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7c00, rc 0) 00000100:00100000:1.0:1789683432.293201:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+43:11572:x1876618802978048:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 3870us (4167us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1789683432.293217:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 200 00000100:00100000:3.0:1789683432.304053:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.304301:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802978304 00000100:00100000:2.0:1789683432.304312:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802978304 00000100:00100000:2.0:1789683432.304375:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:2.0:1789683432.304387:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+43:11572:x1876618802978304:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683432.304411:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683432.304433:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff765 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0307 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.304534:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff76c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.304549:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff76c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.304567:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff76c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683432.304580:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789683432.304897:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff765 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0307 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.304914:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff76c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0307 expref: 45 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.304930:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe46df9d00) 00010000:00010000:2.0:1789683432.304933:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789683432.304936:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908c00, rc 0) 00000100:00100000:2.0:1789683432.304992:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+45:11572:x1876618802978304:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 608us (949us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789683432.305000:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 201 00000100:00100000:0.0:1789683432.308851:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.312633:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802978432 00000100:00100000:2.0:1789683432.312648:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802978432 00000100:00100000:2.0:1789683432.313007:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1789683432.313021:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+45:2352:x1876618802978432:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683432.313038:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683432.313074:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff757 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0300 expref: 45 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.313097:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe46df9d00) 00010000:00010000:2.0:1789683432.313102:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683432.314927:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+44:2352:x1876618802978432:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 1899us (6084us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.314941:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:0.0:1789683432.326530:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.326748:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802978560 00000100:00100000:2.0:1789683432.326759:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802978560 00000100:00100000:2.0:1789683432.326845:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:2.0:1789683432.326858:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+6:2353:x1876618802978560:12345-192.168.203.60@tcp:1:lfs.0 00010000:00010000:2.0:1789683432.326905:0:6676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.326940:0:6676:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.326949:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683432.326954:0:6676:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683432.326959:0:6676:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.326996:0:6676:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 6 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.327011:0:6676:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 6 pid: 6674 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.327026:0:6676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6676:1876618815553920:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683432.327289:0:6676:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683432.333189:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.333364:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802978688 00000100:00100000:0.0:1789683432.333374:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802978688 00010000:00010000:0.0:1789683432.333416:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 7 pid: 6674 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683432.333464:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1789683432.333474:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802978688:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683432.333489:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789683432.333509:0:5815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789683432.333512:0:5815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789683432 00002000:00010000:0.0:1789683432.333514:0:5815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789683432 00002000:00010000:0.0:1789683432.333516:0:5815:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1789683432.333522:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 7 pid: 6674 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.333535:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 7 pid: 6674 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.333590:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683432.333595:0:5815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789683432.333602:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.333611:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.333632:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683432.333720:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802978688:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 247us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.333728:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00010000:00010000:2.0:1789683432.334363:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000062208589/0x59bee33f93ff73b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f2 expref: 6 pid: 6674 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.334382:0:6676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6676:1876618815553920:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683432.334403:0:6676:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.334413:0:6676:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.334429:0:6676:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.334454:0:6676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.334461:0:6676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.334469:0:6676:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.334476:0:6676:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683432.334480:0:6676:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.334489:0:6676:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.334504:0:6676:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.334511:0:6676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ff77a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6676 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.334587:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802978560:12345-192.168.203.60@tcp:1:lfs.0 Request processed in 7732us (8068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.334595:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:3.0:1789683432.336937:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.337148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802978944 00000100:00100000:2.0:1789683432.337159:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802978944 00000100:00100000:2.0:1789683432.337216:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 56 00000100:00100000:2.0:1789683432.337225:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7085c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+44:11572:x1876618802978944:12345-192.168.203.60@tcp:35:lfs.0 00000004:00010000:2.0:1789683432.337288:0:5833:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff76c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0307 expref: 44 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683432.337541:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789683432.337587:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789683432.337966:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1789683432.338022:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.338037:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02e4 expref: 48 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.338045:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.339150:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02e4 expref: 48 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.339168:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02e4 expref: 48 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.339200:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1876618815554048:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683432.339292:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683432.348006:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5833:1876618815554048:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683432.348035:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683432.349800:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.349857:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802979072 00000100:00100000:0.0:1789683432.349867:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802979072 00010000:00010000:0.0:1789683432.349909:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02e4 expref: 49 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683432.349950:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:0.0:1789683432.349961:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+49:2353:x1876618802979072:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683432.349976:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683432.349982:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02e4 expref: 49 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.349995:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02e4 expref: 49 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.350036:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02e4 expref: 49 pid: 9827 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.350052:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe46df9d00) 00010000:00010000:0.0:1789683432.350067:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.350078:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.350086:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.350117:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683432.350173:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+48:2353:x1876618802979072:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 213us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.350180:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00010000:00010000:2.0:1789683432.350373:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.350382:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789683432.350505:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:2.0:1789683432.350729:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1789683432.350868:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1876618815554176:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789683432.350916:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683432.350941:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683432.350993:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815554176 00000100:00100000:1.0:1789683432.351004:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815554176 00000100:00100000:1.0:1789683432.351044:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683432.351052:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876618815554176:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789683432.351144:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c172a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876618815554176:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.351150:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683432.351705:0:5833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:3.0:1789683432.351713:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe7c11a680, transno 4294967307 00000100:00100000:3.0:1789683432.351728:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1876618815554176:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789683432.352150:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:3.0:1789683432.352215:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76137800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1876618815554304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789683432.352257:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683432.352286:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683432.352771:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815554304 00000100:00100000:1.0:1789683432.352778:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815554304 00000100:00100000:1.0:1789683432.352819:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789683432.352828:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1876618815554304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789683432.353052:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1876618815554304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 225us (793us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789683432.353070:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683432.354982:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76137800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5833:1876618815554304:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789683432.355079:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1789683432.355137:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.355148:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.355155:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.355161:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683432.355165:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.355173:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.355188:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe46df9d00) 00010000:00010000:3.0:1789683432.355203:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789683432.355209:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.355215:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff781 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683432.355410:0:5833:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1789683432.355532:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:3.0:1789683432.355546:0:5833:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 365986871328ns, next at 366986868781ns, rc = 0 00000001:00080000:3.0:1789683432.355552:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1789683432.355588:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe46df9d00) 00010000:00010000:3.0:1789683432.355591:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789683432.355598:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff76c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0307 expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683432.355736:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7085c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+51:11572:x1876618802978944:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 18511us (18807us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1789683432.355746:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 56 00000020:00080000:3.0:1789683432.355752:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789683432.359901:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.360167:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802979200 00000100:00100000:2.0:1789683432.360177:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802979200 00000100:00100000:2.0:1789683432.360239:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 202 00000100:00100000:2.0:1789683432.360249:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+51:11572:x1876618802979200:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683432.360271:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683432.360295:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff788 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f030e expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.360356:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f030e expref: 52 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.360389:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f030e expref: 52 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.360409:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683432.360412:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683432.360416:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909a00, rc 0) 00000100:00100000:2.0:1789683432.360478:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+52:11572:x1876618802979200:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 230us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.360486:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 202 00000100:00100000:0.0:1789683432.367512:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.367710:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802979456 00000100:00100000:2.0:1789683432.367720:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802979456 00000100:00100000:2.0:1789683432.367777:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:2.0:1789683432.367788:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+52:11572:x1876618802979456:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1789683432.369938:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+53:11572:x1876618802979456:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 269us (552us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1789683432.369953:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 57 00000100:00100000:3.0:1789683432.487980:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.488100:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802979584 00000100:00100000:1.0:1789683432.488110:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802979584 00000100:00100000:1.0:1789683432.488176:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:1.0:1789683432.488187:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+53:11582:x1876618802979584:12345-192.168.203.60@tcp:34:lfs.0 00010000:00010000:1.0:1789683432.488264:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488282:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488295:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488311:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488336:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488345:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488435:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488444:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488450:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789683432.488491:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488503:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488509:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488516:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488521:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683432.488525:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488532:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488552:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683432.488555:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683432.488561:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488569:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff78f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488584:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488590:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488596:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488601:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683432.488604:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488610:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488617:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe46df9b00) 00010000:00010000:1.0:1789683432.488619:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683432.488622:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488627:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488654:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488660:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488666:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488721:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683432.488724:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488730:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488738:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683432.488740:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683432.488743:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.488749:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff79d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.488841:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+53:11582:x1876618802979584:12345-192.168.203.60@tcp:34:lfs.0 Request processed in 646us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.488848:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 203 00000100:00100000:3.0:1789683432.546220:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.546378:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802979840 00000100:00100000:2.0:1789683432.546388:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802979840 00000100:00100000:2.0:1789683432.546452:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:2.0:1789683432.546463:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+53:11585:x1876618802979840:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683432.546483:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683432.546504:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff7a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0315 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546573:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546601:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546613:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546629:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546636:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546642:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546787:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546796:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546803:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683432.546812:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789683432.546917:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546925:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546933:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546944:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683432.546949:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546958:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546970:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:2.0:1789683432.546974:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683432.546979:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.546986:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff7ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547000:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547006:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547012:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547016:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683432.547019:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547024:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547040:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe6097c600) 00010000:00010000:2.0:1789683432.547043:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683432.547046:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547051:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547106:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff7a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0315 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547118:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0315 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.547124:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683432.547126:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683432.547129:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908000, rc 0) 00000100:00100000:2.0:1789683432.547196:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:11585:x1876618802979840:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 735us (985us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789683432.547203:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 204 00000100:00100000:0.0:1789683432.550249:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.550374:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802979968 00000100:00100000:1.0:1789683432.550385:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802979968 00000100:00100000:1.0:1789683432.550439:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:1.0:1789683432.550463:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:11585:x1876618802979968:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:1.0:1789683432.550544:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.550559:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.550571:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.550597:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.550604:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.550611:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.550617:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683432.550622:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.550629:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.550640:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683432.550643:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683432.550648:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.550653:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.550762:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:11585:x1876618802979968:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 301us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.550769:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 205 00000100:00100000:3.0:1789683432.553025:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.553189:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802980224 00000100:00100000:2.0:1789683432.553198:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802980224 00000100:00100000:2.0:1789683432.553250:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:2.0:1789683432.553261:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+55:11585:x1876618802980224:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1789683432.553495:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:11585:x1876618802980224:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 234us (477us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1789683432.553502:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 58 00000100:00100000:3.0:1789683432.643482:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.643607:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802980480 00000100:00100000:2.0:1789683432.643617:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802980480 00000100:00100000:2.0:1789683432.643723:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 206 00000100:00100000:2.0:1789683432.643734:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:11596:x1876618802980480:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1789683432.643758:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683432.643762:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789683432.643799:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7200/0x59bee33f93ff749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02f9 expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.643820:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:2.0:1789683432.643825:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683432.643846:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff7ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f031c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.643940:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.643954:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0315 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.643962:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.643992:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0315 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.644003:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0315 expref: 56 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.644030:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c173b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815554432:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683432.644123:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e9693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683432.646517:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c173b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5829:1876618815554432:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683432.646543:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683432.651004:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.651110:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802980608 00000100:00100000:2.0:1789683432.651120:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802980608 00010000:00010000:2.0:1789683432.651164:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0315 expref: 57 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.651210:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:2.0:1789683432.651220:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+57:2352:x1876618802980608:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683432.651238:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683432.651245:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0315 expref: 57 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.651259:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0315 expref: 57 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.651282:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff7b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0315 expref: 57 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.651307:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683432.651313:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.651339:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.651348:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.651388:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683432.651451:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:2352:x1876618802980608:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 232us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.651458:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00010000:00010000:1.0:1789683432.651572:0:5829:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.651581:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683432.651603:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789683432.651798:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff7ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f031c expref: 57 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.651814:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f031c expref: 56 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.651821:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683432.651823:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789683432.651826:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909200, rc 0) 00000100:00100000:1.0:1789683432.651875:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76136680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:11596:x1876618802980480:12345-192.168.203.60@tcp:101:bash.0 Request processed in 8144us (8404us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1789683432.651882:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 206 00000100:00100000:3.0:1789683432.654295:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.654528:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802980864 00000100:00100000:1.0:1789683432.654538:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802980864 00000100:00100000:1.0:1789683432.654600:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 207 00000100:00100000:1.0:1789683432.654611:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+56:11596:x1876618802980864:12345-192.168.203.60@tcp:36:bash.0 00010000:00010000:1.0:1789683432.654947:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.654973:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.654985:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683432.655041:0:6698:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1789683432.655067:0:6698:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c02f5a30 reply state 0000000036dfa400 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.655075:0:6698:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683432.655169:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+59:11596:x1876618802980864:12345-192.168.203.60@tcp:36:bash.0 Request processed in 559us (883us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1789683432.655176:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 207 00000020:00080000:1.0:1789683432.655181:0:6698:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789683432.661467:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.661483:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.661491:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.661496:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683432.661501:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.661509:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.661524:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683432.661527:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683432.661532:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.661627:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6200/0x59bee33f93ff7e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683432.661858:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.662136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802980992 00000100:00100000:0.0:1789683432.662147:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802980992 00000100:00100000:0.0:1789683432.662211:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:0.0:1789683432.662220:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+58:11596:x1876618802980992:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:0.0:1789683432.662244:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683432.662261:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff7ea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0323 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.662339:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.662360:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f031c expref: 59 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.662369:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.662404:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f031c expref: 59 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.662418:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f031c expref: 59 pid: 5829 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683432.662432:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815554560:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683432.662507:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e93bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683432.666045:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.666245:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802981120 00000100:00100000:2.0:1789683432.666257:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802981120 00010000:00010000:2.0:1789683432.666307:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f031c expref: 60 pid: 5829 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.666363:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:2.0:1789683432.666372:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:2353:x1876618802981120:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683432.666385:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683432.666392:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f031c expref: 60 pid: 5829 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.666406:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f031c expref: 60 pid: 5829 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.666429:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683432.666435:0:5814:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.666446:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.666455:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.666475:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683432.666534:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:2353:x1876618802981120:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 163us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.666542:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00010000:00010000:1.0:1789683432.667470:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff7d5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f031c expref: 59 pid: 5829 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.667488:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815554560:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683432.667507:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.667516:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.667521:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683432.667571:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789683432.667583:0:5830:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789683432.667604:0:5830:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.667632:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff7ea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0323 expref: 59 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.667645:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0323 expref: 58 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.667652:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683432.667655:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683432.667658:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f200, rc 0) 00000100:00100000:1.0:1789683432.667725:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+58:11596:x1876618802980992:12345-192.168.203.60@tcp:101:bash.0 Request processed in 5505us (5871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.667732:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 208 00000100:00100000:3.0:1789683432.670160:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.670228:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802981376 00000100:00100000:2.0:1789683432.670236:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802981376 00000100:00100000:2.0:1789683432.670285:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:2.0:1789683432.670294:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+58:11596:x1876618802981376:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:2.0:1789683432.670519:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+59:11596:x1876618802981376:12345-192.168.203.60@tcp:35:bash.0 Request processed in 225us (365us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1789683432.670527:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 59 00000100:00100000:3.0:1789683432.739811:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.739971:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802981504 00000100:00100000:1.0:1789683432.739982:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802981504 00000100:00100000:1.0:1789683432.740047:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:1.0:1789683432.740058:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+59:11602:x1876618802981504:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683432.740082:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683432.740103:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff7f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f032a expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.740167:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff7ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.740182:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.740222:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683432.740258:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1789683432.740262:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789683432.740285:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff7ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.740309:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff7f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f032a expref: 61 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.740328:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff7ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f032a expref: 60 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.740336:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683432.740339:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683432.740342:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6c00, rc 0) 00000100:00100000:1.0:1789683432.740407:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76136d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:11602:x1876618802981504:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 350us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.740413:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 209 00000100:00100000:0.0:1789683432.743635:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.744039:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802981632 00000100:00100000:1.0:1789683432.744050:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802981632 00000100:00100000:1.0:1789683432.744154:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 210 00000100:00100000:1.0:1789683432.744165:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:11602:x1876618802981632:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683432.744187:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683432.744207:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff806 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0331 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744289:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744303:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744313:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744327:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744334:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744355:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744438:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744448:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744455:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789683432.744502:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789683432.744507:0:9827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789683432.744533:0:9827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744558:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744566:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744573:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744580:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744586:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683432.744590:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744596:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744608:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683432.744611:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683432.744616:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744623:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff80d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744636:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744643:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744659:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744665:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683432.744668:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744697:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744705:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe46df9b00) 00010000:00010000:1.0:1789683432.744708:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683432.744711:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744717:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7600/0x59bee33f93ff814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744751:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7c00/0x59bee33f93ff806 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 62 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744765:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 61 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.744772:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683432.744775:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683432.744778:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7800, rc 0) 00000100:00100000:1.0:1789683432.744855:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11602:x1876618802981632:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 691us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.744872:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 210 00000100:00100000:3.0:1789683432.752838:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.753000:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802981888 00000100:00100000:1.0:1789683432.753011:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802981888 00000100:00100000:1.0:1789683432.753068:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:1.0:1789683432.753078:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11602:x1876618802981888:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683432.753100:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683432.753120:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff822 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0338 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.753219:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.753234:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0323 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.753241:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 62 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.753248:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.753280:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 62 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.753292:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 62 pid: 9827 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.753306:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815554688:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683432.753426:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0323 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.753435:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0323 expref: 62 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.753444:0:5830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815554816:192.168.203.60@tcp:104: 00000100:00100000:1.0:1789683432.753466:0:5830:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7c40ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683432.754881:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.756055:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802982016 00000100:00100000:1.0:1789683432.756069:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802982016 00010000:00010000:1.0:1789683432.756116:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 63 pid: 9827 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.756161:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1789683432.756171:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+63:2355:x1876618802982016:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683432.756184:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683432.756191:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 63 pid: 9827 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.756205:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 63 pid: 9827 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.756229:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683432.756234:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.756243:0:7627:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.756262:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683432.756537:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+63:2355:x1876618802982016:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 365us (1661us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.756544:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:0.0:1789683432.765810:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.766064:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802982144 00000100:00100000:2.0:1789683432.766073:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802982144 00010000:00010000:2.0:1789683432.766109:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0323 expref: 63 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.766148:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:2.0:1789683432.766158:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+63:2352:x1876618802982144:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683432.766170:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683432.766177:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0323 expref: 63 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.766189:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0323 expref: 63 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.766209:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683432.766214:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.766239:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.766247:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.766263:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683432.766307:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+63:2352:x1876618802982144:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 151us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.766314:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00010000:00010000:1.0:1789683432.766979:0:5830:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.60@tcp) returned -22 from blocking AST (req@00000000cc48795e x1876618815554688) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 62 pid: 9827 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.766994:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff81b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0331 expref: 62 pid: 9827 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.767011:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca3100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815554688:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683432.767073:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93ff7f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0323 expref: 61 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.767084:0:5830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca2680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5830:1876618815554816:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683432.767103:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683432.767111:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.767119:0:5830:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.767126:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683432.767144:0:5830:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789683432.767276:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6000/0x59bee33f93ff822 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0338 expref: 62 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.767291:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0338 expref: 61 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.767308:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683432.767310:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789683432.767313:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6800, rc 0) 00000100:00100000:2.0:1789683432.767357:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11602:x1876618802981888:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 14280us (14537us total) trans 4294967503 rc 0/0 00000100:00100000:2.0:1789683432.767364:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 211 00000100:00100000:2.0:1789683432.772515:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.772707:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802982400 00000100:00100000:0.0:1789683432.772718:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802982400 00000100:00100000:0.0:1789683432.772796:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1789683432.772808:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11602:x1876618802982400:12345-192.168.203.60@tcp:103:lfs.0 00010000:00010000:0.0:1789683432.772824:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683432.772858:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff788 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f030e expref: 61 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.772876:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:0.0:1789683432.772881:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683432.772951:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c173b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:11602:x1876618802982400:12345-192.168.203.60@tcp:103:lfs.0 Request processed in 146us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.772958:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1789683432.777996:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.778163:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802982528 00000100:00100000:2.0:1789683432.778173:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802982528 00000100:00100000:2.0:1789683432.778237:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00100000:2.0:1789683432.778248:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:11602:x1876618802982528:12345-192.168.203.60@tcp:58:lfs.0 00010000:00010000:2.0:1789683432.778343:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.778358:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.778369:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683432.778561:0:6698:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1789683432.778651:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:11602:x1876618802982528:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 404us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.778659:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 212 00000100:00100000:3.0:1789683432.784491:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.784586:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802982656 00000100:00100000:1.0:1789683432.784597:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802982656 00000100:00100000:1.0:1789683432.784657:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 213 00000100:00100000:1.0:1789683432.784669:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+60:11602:x1876618802982656:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:1.0:1789683432.784712:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683432.784734:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff83e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f033f expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.784802:0:9827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.784814:0:9827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff83e lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f033f expref: 61 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.784843:0:9827:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.784871:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff83e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f033f expref: 61 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.784885:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683432.784888:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683432.784892:0:9827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff83e lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f033f expref: 61 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.784899:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7800, rc 0) 00000100:00100000:1.0:1789683432.784961:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76d01180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11602:x1876618802982656:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 295us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.784968:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 213 00000040:00080000:2.0:1789683432.800131:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789683432.800140:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683432.800175:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1789683432.800194:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683432.800312:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c171880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815554944:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789683432.800408:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683432.813439:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.813601:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c171880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815554944:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789683432.813657:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802982784 00000100:00100000:0.0:1789683432.813666:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802982784 00000100:00100000:0.0:1789683432.813751:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:0.0:1789683432.813759:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11603:x1876618802982784:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789683432.813923:0:5830:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789683432.814029:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11603:x1876618802982784:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 269us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.814036:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 214 00000100:00100000:0.0:1789683432.819048:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.819169:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802982912 00000100:00100000:2.0:1789683432.819180:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802982912 00000100:00100000:2.0:1789683432.819244:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:2.0:1789683432.819253:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11603:x1876618802982912:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789683432.819331:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819348:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819359:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819374:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819382:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819387:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819410:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819417:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819437:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683432.819476:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789683432.819481:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683432.819494:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819505:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819511:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819519:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819524:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683432.819528:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819535:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819546:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:2.0:1789683432.819616:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683432.819623:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819630:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff845 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819656:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819662:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819668:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819729:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683432.819733:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819740:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819748:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8dbe6097c600) 00010000:00010000:2.0:1789683432.819750:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683432.819753:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819758:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff84c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819773:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819780:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819896:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819909:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683432.819913:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819919:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819927:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683432.819929:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683432.819933:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.819938:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff853 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.820087:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11603:x1876618802982912:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 833us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.820095:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 215 00000100:00100000:1.0:1789683432.822269:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.822384:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802983168 00000100:00100000:0.0:1789683432.822394:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802983168 00000100:00100000:0.0:1789683432.822448:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:0.0:1789683432.822456:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+61:11603:x1876618802983168:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683432.822477:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683432.822495:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff85a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0346 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.822653:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.822669:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.822755:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683432.822781:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789683432.822969:0:9827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.822977:0:9827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.822984:0:9827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.822989:0:9827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ee00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683432.822994:0:9827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.823002:0:9827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.823014:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:0.0:1789683432.823017:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789683432.823022:0:9827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.823028:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff861 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.823069:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff85a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0346 expref: 63 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.823080:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:0.0:1789683432.823082:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789683432.823092:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff85a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0346 expref: 63 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.823102:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ec00, rc 0) 00000100:00100000:0.0:1789683432.823219:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+62:11603:x1876618802983168:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 763us (958us total) trans 4294967504 rc 301/301 00000100:00100000:0.0:1789683432.823226:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 216 00000100:00100000:3.0:1789683432.826011:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.826105:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802983296 00000100:00100000:2.0:1789683432.826115:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802983296 00000100:00100000:2.0:1789683432.826173:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:2.0:1789683432.826184:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+62:11603:x1876618802983296:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789683432.826218:0:5831:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789683432.826394:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+62:11603:x1876618802983296:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 211us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.826402:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 217 00000100:00100000:1.0:1789683432.829993:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.830108:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802983552 00000100:00100000:2.0:1789683432.830118:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802983552 00000100:00100000:2.0:1789683432.830234:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:2.0:1789683432.830244:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+62:11603:x1876618802983552:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683432.830266:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683432.830269:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789683432.830296:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6c00/0x59bee33f93ff7ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f032a expref: 62 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.830313:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:2.0:1789683432.830319:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683432.830332:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff86f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f034d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789683432.830940:0:5829:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1789683432.831146:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff876 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.831162:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.831174:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff876 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.831234:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff86f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f034d expref: 64 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.831252:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff876 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f034d expref: 63 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.831259:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:2.0:1789683432.831272:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683432.831276:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909000, rc 0) 00000100:00100000:2.0:1789683432.831405:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+63:11603:x1876618802983552:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1162us (1422us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789683432.831414:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 218 00000100:00100000:3.0:1789683432.834288:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.834381:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802983808 00000100:00100000:1.0:1789683432.834390:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802983808 00000100:00100000:1.0:1789683432.834442:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:1.0:1789683432.834452:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+63:11603:x1876618802983808:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789683432.834517:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683432.834543:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909000/0x59bee33f93ff876 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f034d expref: 63 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834572:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:1.0:1789683432.834582:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789683432.834602:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834633:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834644:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834658:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834665:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834705:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834770:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834777:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834783:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834800:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683432.834804:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834811:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834819:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683432.834838:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683432.834843:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834849:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6a00/0x59bee33f93ff884 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834862:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834868:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834873:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834877:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683432.834879:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834885:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834891:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x3440960d (ffff8dbe46df9b00) 00010000:00010000:1.0:1789683432.834894:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683432.834896:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.834901:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7a00/0x59bee33f93ff88b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x3440960d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5830 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.835292:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+62:11603:x1876618802983808:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 838us (1010us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683432.835311:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 219 00000100:00100000:3.0:1789683432.837325:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.837644:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802983936 00000100:00100000:0.0:1789683432.837652:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802983936 00000100:00100000:0.0:1789683432.837931:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:0.0:1789683432.837944:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+62:11603:x1876618802983936:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683432.837968:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683432.837990:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff892 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0354 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.838027:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.838039:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.838051:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.838151:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff892 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0354 expref: 64 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.838170:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0354 expref: 63 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.838189:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:0.0:1789683432.838192:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789683432.838196:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ee00, rc 0) 00000100:00100000:0.0:1789683432.838256:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+63:11603:x1876618802983936:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 316us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.838263:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 220 00000100:00100000:2.0:1789683432.840508:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.841329:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802984192 00000100:00100000:1.0:1789683432.841340:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802984192 00000100:00100000:1.0:1789683432.841399:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:1.0:1789683432.841411:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+63:11603:x1876618802984192:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789683432.841495:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.841511:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.841523:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683432.841819:0:9827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:1.0:1789683432.841920:0:9827:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001dfea0fb reply state 000000000ced2c13 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.841931:0:9827:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789683432.842024:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c171880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+65:11603:x1876618802984192:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 613us (1521us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789683432.842031:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 221 00000100:00100000:1.0:1789683432.844573:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.845171:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802984320 00000100:00100000:2.0:1789683432.845183:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802984320 00000100:00100000:2.0:1789683432.845239:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 222 00000100:00100000:2.0:1789683432.845248:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+65:11603:x1876618802984320:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683432.845275:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683432.845298:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f035b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.845364:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f035b expref: 66 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.845379:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f035b expref: 66 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.845401:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:2.0:1789683432.845403:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789683432.845408:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909600, rc 0) 00000100:00100000:2.0:1789683432.845560:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+66:11603:x1876618802984320:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 312us (994us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.845567:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 222 00010000:00010000:0.0:1789683432.845702:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.845712:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.845719:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.845724:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683432.845729:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.845736:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.845748:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:0.0:1789683432.845751:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789683432.845754:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.845759:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6400/0x59bee33f93ff8a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.848436:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.848536:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802984448 00000100:00100000:0.0:1789683432.848605:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802984448 00000100:00100000:0.0:1789683432.848731:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:0.0:1789683432.848741:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2352:x1876618802984448:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789683432.849097:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c171c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2352:x1876618802984448:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 357us (669us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789683432.849105:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:2.0:1789683432.851527:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.852963:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802984704 00000100:00100000:1.0:1789683432.852980:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802984704 00000100:00100000:1.0:1789683432.853053:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:1.0:1789683432.853065:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+65:11603:x1876618802984704:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789683432.853319:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+66:11603:x1876618802984704:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 256us (1800us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789683432.853340:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 60 00000100:00100000:1.0:1789683432.860058:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.860253:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802984960 00000100:00100000:2.0:1789683432.860264:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802984960 00000100:00100000:2.0:1789683432.860325:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:2.0:1789683432.860335:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+66:11603:x1876618802984960:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683432.860453:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+66:11603:x1876618802984960:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 120us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.860460:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 223 00000100:00100000:3.0:1789683432.863096:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.863166:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802985088 00000100:00100000:2.0:1789683432.863178:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802985088 00000100:00100000:2.0:1789683432.863236:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:2.0:1789683432.863248:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+66:11603:x1876618802985088:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683432.863269:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683432.863291:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff8ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0362 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.863359:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.863374:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.863387:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683432.863426:0:5829:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683432.863444:0:5829:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.863502:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ff8ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0362 expref: 68 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.863521:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0362 expref: 67 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.863529:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:2.0:1789683432.863532:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789683432.863536:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909400, rc 0) 00000100:00100000:2.0:1789683432.864011:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+67:11603:x1876618802985088:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 763us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.864019:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 224 00000100:00100000:1.0:1789683432.867440:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683432.867539:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802985216 00000100:00100000:3.0:1789683432.867618:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802985216 00000100:00100000:3.0:1789683432.867770:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:3.0:1789683432.867781:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+10:2353:x1876618802985216:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683432.867809:0:6674:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683432.867840:0:6674:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0369 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683432.867867:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac66e9, blocks: 0x1 00010000:00010000:3.0:1789683432.867886:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=366s v=(0 0) 00010000:00010000:3.0:1789683432.867890:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683432.867900:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0369 expref: 11 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.867918:0:6674:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0369 expref: 11 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.867948:0:6674:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8a00, rc 0) 00000100:00100000:3.0:1789683432.868110:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76244c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:2353:x1876618802985216:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 330us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683432.868117:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1789683432.871130:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.871235:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802985472 00000100:00100000:2.0:1789683432.871245:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802985472 00000100:00100000:2.0:1789683432.871344:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:2.0:1789683432.871355:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+67:11603:x1876618802985472:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789683432.871465:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+67:11603:x1876618802985472:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 111us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.871472:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 225 00000100:00100000:0.0:1789683432.873877:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.873994:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802985600 00000100:00100000:2.0:1789683432.874004:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802985600 00000100:00100000:2.0:1789683432.874055:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:2.0:1789683432.874064:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:11603:x1876618802985600:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683432.874083:0:8465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683432.874102:0:8465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0370 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.874152:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0369 expref: 12 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.874160:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683432.874164:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683432.874168:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 12 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.874200:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0369 expref: 12 pid: 6674 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.874214:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0369 expref: 12 pid: 6674 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.874227:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1876618815555072:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683432.874318:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969480 going to sleep for 11 seconds 00000100:00100000:1.0:1789683432.877041:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.877135:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1876618815555072:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683432.877166:0:8465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 12 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.877186:0:8465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908a00, rc 0) 00000100:00100000:2.0:1789683432.877246:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:11603:x1876618802985600:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 3183us (3376us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.877255:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:0.0:1789683432.877721:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802985728 00000100:00100000:0.0:1789683432.877730:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802985728 00010000:00010000:0.0:1789683432.877765:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0369 expref: 12 pid: 6674 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683432.877811:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:0.0:1789683432.877821:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:2352:x1876618802985728:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683432.877843:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683432.877864:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0369 expref: 12 pid: 6674 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.877876:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0369 expref: 12 pid: 6674 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.877898:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ff8bc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0369 expref: 12 pid: 6674 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.877924:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683432.877927:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683432.877935:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 11 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.877944:0:7627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 11 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.877977:0:7627:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 11 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683432.877990:0:7627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7627:1876618815555200:192.168.203.60@tcp:105: 00000100:00100000:0.0:1789683432.878050:0:7627:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e93b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683432.880947:0:7627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7627:1876618815555200:192.168.203.60@tcp:105: 00010000:00010000:0.0:1789683432.880971:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683432.881028:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:2352:x1876618802985728:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 3207us (3993us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.881037:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:1.0:1789683432.884866:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.884983:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802985856 00000100:00100000:0.0:1789683432.884994:0:6680:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802985856 00002000:00100000:0.0:1789683432.885044:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8dbe7c431180 x1876618802985856/t0(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:488/0 lens 504/0 e 0 to 0 dl 1789683443 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683432.885056:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe7c431180 with x1876618802985856 ext(0->12) 00002000:00010000:0.0:1789683432.885061:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe7c431180 00000100:00100000:0.0:1789683432.885102:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1789683432.885111:0:6680:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+11:2352:x1876618802985856:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789683432.885554:0:6680:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c431180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:2352:x1876618802985856:12345-192.168.203.60@tcp:4:lhsmtool_posix.0 Request processed in 443us (696us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789683432.885563:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00002000:00100000:0.0:1789683432.885570:0:6680:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8dbe7c431180 x1876618802985856/t4294967320(0) o4->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:488/0 lens 504/448 e 0 to 0 dl 1789683443 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789683432.885578:0:6680:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe7c431180 with x1876618802985856 ext(0->12) 00002000:00010000:0.0:1789683432.885582:0:6680:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe7c431180 00000100:00100000:3.0:1789683432.889343:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.889649:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802985984 00000100:00100000:0.0:1789683432.889659:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802985984 00000100:00100000:0.0:1789683432.889748:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 226 00000100:00100000:0.0:1789683432.889757:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+67:11603:x1876618802985984:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1789683432.926858:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+67:11603:x1876618802985984:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 37091us (37517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.926870:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 226 00000001:00080000:1.0:1789683432.928357:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000001:00080000:1.0:1789683432.928391:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:1.0:1789683432.928406:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1789683432.928466:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dbe5309f840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1789683432.928471:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe76f8b500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe5309f3c0 00000020:00080000:1.0:1789683432.928474:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe76f8b000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe7612c000 00000004:00080000:1.0:1789683432.928497:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789683432.928515:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dbe7b952c00 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1789683432.928518:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe7c174d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe7b952000 00000020:00080000:1.0:1789683432.928520:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe7c174b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe76d3e000 00000100:00100000:1.0:1789683432.928754:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683432.928771:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815555328:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1789683432.928886:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789683432.929076:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1789683432.929167:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683432.929363:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815555456:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789683432.929389:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683432.930253:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815555328 00000100:00100000:2.0:1789683432.930263:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815555328 00000100:00100000:2.0:1789683432.930346:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815555456 00000100:00100000:2.0:1789683432.930349:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815555456 00000100:00100000:2.0:1789683432.930379:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789683432.930388:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3302:x1876618815555328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789683432.930416:0:6674:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1789683432.930450:0:6674:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aac66e8, atime: 0x0, ctime: 0x6aac66e8, blocks: 0xb 00010000:00010000:2.0:1789683432.930459:0:6674:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.930475:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1789683432.930480:0:6674:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683432.930486:0:6674:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.930502:0:6674:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.930513:0:6674:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.930521:0:6674:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.930539:0:6674:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789683432.930634:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789683432.930644:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815555456:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789683432.930658:0:8465:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1789683432.930688:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.930702:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02cf expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.930710:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789683432.930713:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683432.930716:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.930745:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02cf expref: 12 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.930758:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02cf expref: 12 pid: 6674 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683432.930793:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76be0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1876618815555584:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683432.930878:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952540 going to sleep for 11 seconds 00000100:00100000:2.0:1789683432.931973:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3302:x1876618815555328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1583us (2804us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1789683432.931992:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:1.0:1789683432.932140:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683432.932150:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.932172:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683432.932177:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.932187:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.932205:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.932212:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fa10777/0x59bee33f93ff8ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6674 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.932231:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683432.932233:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683432.932235:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683432.935276:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.935422:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802986112 00000100:00100000:2.0:1789683432.935431:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802986112 00000100:00100000:2.0:1789683432.935535:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:2.0:1789683432.935555:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:2352:x1876618802986112:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789683432.935864:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76be0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1876618815555584:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683432.935892:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789683432.936508:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe7c431880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789683432.936516:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815555328:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789683432.936670:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683432.936817:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802986240 00000100:00100000:3.0:1789683432.936824:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802986240 00010000:00010000:3.0:1789683432.936861:0:5814:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02cf expref: 14 pid: 6674 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683432.936899:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:3.0:1789683432.936907:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+14:2353:x1876618802986240:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683432.936918:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683432.936924:0:5814:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02cf expref: 14 pid: 6674 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.936937:0:5814:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02cf expref: 14 pid: 6674 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.936960:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9864f02/0x59bee33f93ff68c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02cf expref: 14 pid: 6674 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.936977:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683432.936981:0:5814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789683432.936994:0:5814:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.937003:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.937026:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683432.937070:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+13:2353:x1876618802986240:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 163us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683432.937077:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00010000:00010000:0.0:1789683432.937745:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.937765:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.937775:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.937792:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.937814:0:8465:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789683432.938370:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3304:x1876618815555456:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7726us (8977us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789683432.938381:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1789683432.939090:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683432.939098:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.939108:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683432.939113:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.939123:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.939141:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.939149:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ff8d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683432.939188:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683432.939191:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683432.939192:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789683432.939312:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe7c170a80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1789683432.939332:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c170a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815555456:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789683432.968864:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48d86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+12:2352:x1876618802986112:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 33310us (33588us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683432.968878:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000001:00080000:3.0:1789683432.968915:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1789683432.968934:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:0.0:1789683432.971738:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.971911:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802986496 00000100:00100000:2.0:1789683432.971921:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802986496 00000100:00100000:2.0:1789683432.972015:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:2.0:1789683432.972027:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:11603:x1876618802986496:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789683432.972082:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683432.972108:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0362 expref: 20 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.972125:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:2.0:1789683432.972130:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683432.972161:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.972175:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.972185:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683432.972424:0:5829:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000029aeb31a reply state 0000000012e61329 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.972434:0:5829:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789683432.972730:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:11603:x1876618802986496:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 704us (1000us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789683432.972738:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 227 00000100:00100000:3.0:1789683432.975460:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683432.975565:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802986624 00000100:00100000:1.0:1789683432.975575:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802986624 00000100:00100000:1.0:1789683432.975631:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:1.0:1789683432.975642:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802986624:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789683432.975875:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789683432.975879:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789683433 00002000:00010000:1.0:1789683432.975881:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789683432 00002000:00010000:1.0:1789683432.975883:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789683433 -> 1789683433 00002000:00010000:1.0:1789683432.975899:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789683432.975961:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802986624:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 320us (509us total) trans 4294967322 rc 0/0 00000100:00100000:1.0:1789683432.975969:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00010000:00010000:2.0:1789683432.976582:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.976594:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.976602:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.976608:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683432.976613:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.976621:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.976636:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:2.0:1789683432.976640:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683432.976644:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.976650:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683432.978639:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.978927:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802986880 00000100:00100000:2.0:1789683432.978937:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802986880 00000100:00100000:2.0:1789683432.978999:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:2.0:1789683432.979009:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:11603:x1876618802986880:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789683432.979094:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.979111:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0354 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.979121:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.979157:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0354 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.979172:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0354 expref: 20 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.979186:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815555712:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683432.979309:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683432.981861:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815555712:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683432.981890:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683432.984052:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.984123:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802987008 00000100:00100000:2.0:1789683432.984132:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802987008 00010000:00010000:2.0:1789683432.984170:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0354 expref: 21 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.984211:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:2.0:1789683432.984221:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:2353:x1876618802987008:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683432.984247:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683432.984255:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0354 expref: 21 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984267:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0354 expref: 21 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984287:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ee00/0x59bee33f93ff899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0354 expref: 21 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984301:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:2.0:1789683432.984307:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984316:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984323:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984347:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683432.984397:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:2353:x1876618802987008:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 177us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.984403:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00010000:00010000:2.0:1789683432.984428:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984435:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984478:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984498:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984505:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984512:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683432.984516:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984523:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984533:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:2.0:1789683432.984536:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789683432.984540:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.984556:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff8df lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.984595:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11603:x1876618802986880:12345-192.168.203.60@tcp:55:lhsmtool_posix.0 Request processed in 5587us (5964us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789683432.984602:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 228 00000100:00100000:0.0:1789683432.986924:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.987051:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802987136 00000100:00100000:2.0:1789683432.987060:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802987136 00000100:00100000:2.0:1789683432.987150:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 70 00000100:00100000:2.0:1789683432.987171:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802987136:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789683432.987211:0:8465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.987230:0:8465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 8 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.987239:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683432.987243:0:8465:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789683432.987248:0:8465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.987279:0:8465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 8 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.987292:0:8465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 8 pid: 8465 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.987306:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1876618815555840:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683432.987384:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683432.990513:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.991129:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8465:1876618815555840:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683432.991156:0:8465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.991226:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802987264 00000100:00100000:1.0:1789683432.991233:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802987264 00010000:00010000:1.0:1789683432.991269:0:7627:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 9 pid: 8465 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683432.991346:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:1.0:1789683432.991355:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+9:2352:x1876618802987264:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683432.991369:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683432.991391:0:7627:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 9 pid: 8465 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.991403:0:7627:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 9 pid: 8465 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.991426:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a132a0e/0x59bee33f93ff8c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0370 expref: 9 pid: 8465 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.991442:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683432.991445:0:7627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789683432.991450:0:7627:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.991459:0:7627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.991655:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683432.991732:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2352:x1876618802987264:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 377us (1226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683432.991739:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00010000:00010000:2.0:1789683432.991811:0:8465:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.991836:0:8465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.991862:0:8465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.991870:0:8465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.991879:0:8465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.991886:0:8465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909000 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683432.991890:0:8465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.991899:0:8465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.991912:0:8465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.991918:0:8465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092797a5f/0x59bee33f93ff8e6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.991978:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2352:x1876618802987136:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 4810us (5061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683432.991986:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 70 00010000:00010000:0.0:1789683432.992173:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683432.994182:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683432.994362:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802987520 00000100:00100000:2.0:1789683432.994374:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802987520 00000100:00100000:2.0:1789683432.994424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 229 00000100:00100000:2.0:1789683432.994433:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11603:x1876618802987520:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789683432.994522:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.994540:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.994656:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.994991:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.995004:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f035b expref: 20 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.995012:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.995045:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f035b expref: 20 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683432.995078:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f035b expref: 20 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683432.995092:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815555968:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683432.995164:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683432.997588:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815555968:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683432.997615:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683432.999067:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683432.999153:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802987648 00000100:00100000:0.0:1789683432.999162:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802987648 00010000:00010000:0.0:1789683432.999199:0:11663:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f035b expref: 21 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683432.999239:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:0.0:1789683432.999263:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:2353:x1876618802987648:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683432.999277:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683432.999283:0:11663:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f035b expref: 21 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.999295:0:11663:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f035b expref: 21 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.999314:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ff8a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f035b expref: 21 pid: 6698 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.999327:0:11663:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:0.0:1789683432.999332:0:11663:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.999341:0:11663:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.999348:0:11663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683432.999376:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683432.999429:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:2353:x1876618802987648:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 167us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683432.999437:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00010000:00010000:1.0:1789683432.999838:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683432.999847:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789683433.000024:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1789683433.000167:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:1.0:1789683433.000211:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1789683433.000294:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c163480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1876618815556096:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789683433.000346:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.000429:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe46ef1840 going to sleep for 11 seconds 00000100:00100000:2.0:1789683433.004092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815556096 00000100:00100000:2.0:1789683433.004107:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815556096 00000100:00100000:2.0:1789683433.004221:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683433.004234:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1876618815556096:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789683433.004363:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c161180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5831:x1876618815556096:12345-0@lo:1000:mdt00_002.0 Request processed in 133us (4016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683433.004370:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683433.004466:0:5831:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1789683433.004473:0:5831:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1789683433.004509:0:5831:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8dbe7c170a80 x1876618815555456/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789683448 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683433.004523:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c163480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1876618815556096:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789683433.005073:0:5831:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:1.0:1789683433.005157:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c163480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1876618815556224:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789683433.005204:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683433.005234:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe46ef10c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683433.005772:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815556224 00000100:00100000:3.0:1789683433.005779:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815556224 00000100:00100000:3.0:1789683433.005825:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789683433.005842:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5831:x1876618815556224:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789683433.006119:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c163800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5831:x1876618815556224:12345-0@lo:1000:mdt00_002.0 Request processed in 278us (915us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789683433.006126:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683433.006376:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c163480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5831:1876618815556224:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789683433.006424:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006435:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006443:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006449:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683433.006454:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006462:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006476:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe60aa2400) 00010000:00010000:1.0:1789683433.006480:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683433.006659:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006668:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff8f4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006718:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006725:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006731:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006746:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683433.006749:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006755:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006763:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683433.006766:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683433.006772:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff83e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f033f expref: 23 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006859:0:5831:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff83e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f033f expref: 23 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006872:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff83e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f033f expref: 23 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.006904:0:5831:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff83e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f033f expref: 23 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683433.006916:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c163100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815556352:192.168.203.60@tcp:105: 00000100:00100000:1.0:1789683433.007040:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe46ef10c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789683433.007099:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683433.010312:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683433.010416:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c163100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5831:1876618815556352:192.168.203.60@tcp:105: 00010000:00010000:1.0:1789683433.010444:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010469:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff837 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010498:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010511:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010522:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010532:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010538:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010545:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010551:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683433.010555:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010562:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010574:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683433.010577:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683433.010580:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010594:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93ff8fb lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010606:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010612:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010618:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010622:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908e00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683433.010625:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010630:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010638:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683433.010640:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789683433.010642:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.010647:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ff8ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683433.011106:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:11603:x1876618802987520:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 16670us (16929us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789683433.011118:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 229 00000020:00080000:0.0:1789683433.011130:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789683433.011580:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683433.011585:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683433.012281:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789683433.012292:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789683433.012431:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802987776 00000100:00100000:2.0:1789683433.012439:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802987776 00000100:00100000:2.0:1789683433.012497:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00100000:2.0:1789683433.012506:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:11602:x1876618802987776:12345-192.168.203.60@tcp:49:lfs.0 00000100:00100000:2.0:1789683433.012625:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:11602:x1876618802987776:12345-192.168.203.60@tcp:49:lfs.0 Request processed in 120us (2324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683433.012631:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 61 00000100:00080000:0.0:1789683433.013037:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683433.015424:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683433.015633:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802988032 00000100:00100000:2.0:1789683433.015644:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802988032 00000100:00100000:2.0:1789683433.015742:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 62 00000100:00100000:2.0:1789683433.015752:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7085d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+23:11603:x1876618802988032:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789683433.016442:0:5832:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789683433.016546:0:5832:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1789683433.016589:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.016605:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.016617:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.016626:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.016632:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.016639:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.016662:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789683433.016819:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7085d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11603:x1876618802988032:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1066us (1402us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1789683433.016836:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 62 00000020:00080000:2.0:1789683433.016842:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789683433.016944:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683433.016950:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.016958:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683433.016962:0:7626:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.016970:0:7626:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.016983:0:7626:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8dbe6097c700) 00010000:00010000:1.0:1789683433.016986:0:7626:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789683433.016990:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.016995:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff902 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683433.017011:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683433.017013:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683433.017015:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683433.017283:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683433.017369:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802988288 00000100:00100000:2.0:1789683433.017375:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802988288 00000100:00100000:2.0:1789683433.017443:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 230 00000100:00100000:2.0:1789683433.017452:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11602:x1876618802988288:12345-192.168.203.60@tcp:58:lfs.0 00000040:00080000:2.0:1789683433.017629:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789683433.017700:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11602:x1876618802988288:12345-192.168.203.60@tcp:58:lfs.0 Request processed in 248us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683433.017707:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 230 00000100:00100000:0.0:1789683433.047093:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683433.047186:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802988416 00000100:00100000:2.0:1789683433.047197:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802988416 00000100:00100000:2.0:1789683433.047254:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 231 00000100:00100000:2.0:1789683433.047265:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+25:11605:x1876618802988416:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683433.047290:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683433.047309:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff909 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0377 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047371:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047386:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047397:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047412:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047420:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047427:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047731:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047744:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0338 expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047752:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047793:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0338 expref: 26 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.047806:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0338 expref: 26 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683433.047818:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c170380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815556480:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683433.047901:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4e969480 going to sleep for 11 seconds 00000100:00100000:2.0:1789683433.050969:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c170380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6698:1876618815556480:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683433.050999:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683433.052020:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683433.052254:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802988672 00000100:00100000:1.0:1789683433.052263:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802988672 00000100:00100000:1.0:1789683433.052317:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:1.0:1789683433.052328:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:5585:x1876618802988672:12345-192.168.203.60@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789683433.052554:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:5585:x1876618802988672:12345-192.168.203.60@tcp:35:ldlm_bl.0 Request processed in 227us (536us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789683433.052561:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 63 00000100:00100000:0.0:1789683433.054851:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683433.054935:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802988800 00000100:00100000:2.0:1789683433.054944:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802988800 00010000:00010000:2.0:1789683433.054979:0:5815:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0338 expref: 28 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683433.055016:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:2.0:1789683433.055025:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:2353:x1876618802988800:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683433.055053:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683433.055060:0:5815:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0338 expref: 28 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.055072:0:5815:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0338 expref: 28 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.055092:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6800/0x59bee33f93ff829 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0338 expref: 28 pid: 5830 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.055110:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683433.055114:0:5815:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.055124:0:5815:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.055131:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683433.055164:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683433.055221:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+27:2353:x1876618802988800:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 196us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683433.055228:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00010000:00010000:0.0:1789683433.055349:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055357:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683433.055400:0:6698:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789683433.055404:0:6698:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683433.055421:0:6698:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055433:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055442:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055448:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055454:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055459:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683433.055463:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055480:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055500:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:0.0:1789683433.055503:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683433.055507:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055512:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff910 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055523:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055530:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055535:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055540:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683433.055543:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055548:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055554:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8dbe6097c100) 00010000:00010000:0.0:1789683433.055557:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683433.055559:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055575:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ff917 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055624:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ff909 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0377 expref: 27 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055638:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0377 expref: 26 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683433.055645:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:0.0:1789683433.055648:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789683433.055650:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909c00, rc 0) 00000100:00100000:0.0:1789683433.055726:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11605:x1876618802988416:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 8462us (8641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683433.055733:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 231 00000040:00080000:3.0:1789683433.876580:0:12562:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789683433.876592:0:12562:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789683433.877226:0:12562:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1789683433.877236:0:12562:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1789683434.016017:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683434.016036:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683434.016085:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789683434.016095:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683434.016262:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c163100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815556608:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789683434.016452:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe48c8e000 going to sleep for 11 seconds 00010000:00010000:2.0:1789683434.017816:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683434.022029:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c163100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1876618815556608:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789683434.032465:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683434.033259:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802988928 00000100:00100000:0.0:1789683434.033276:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802988928 00000100:00100000:0.0:1789683434.033357:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 232 00000100:00100000:0.0:1789683434.033369:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11617:x1876618802988928:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789683434.033419:0:5831:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789683434.033580:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c163100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11617:x1876618802988928:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 212us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683434.033589:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 232 00000100:00100000:3.0:1789683434.043506:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683434.043628:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802989184 00000100:00100000:2.0:1789683434.043642:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802989184 00000100:00100000:2.0:1789683434.043743:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:2.0:1789683434.043755:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+26:11617:x1876618802989184:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683434.043942:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683434.043971:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff925 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f037e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683434.044109:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff92c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683434.044127:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683434.044140:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff92c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683434.044154:0:5829:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789683434.044307:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ff925 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f037e expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683434.044330:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff92c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f037e expref: 28 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683434.044340:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683434.044345:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683434.044350:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908c00, rc 0) 00000100:00100000:2.0:1789683434.044429:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:11617:x1876618802989184:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 676us (939us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789683434.044437:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 233 00000100:00100000:0.0:1789683434.058129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683434.060062:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683434.060149:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802989568 00000100:00100000:0.0:1789683434.060170:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802989568 00000100:00100000:0.0:1789683434.060238:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 234 00000100:00100000:0.0:1789683434.060251:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:11617:x1876618802989568:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789683434.060358:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683434.060379:0:6698:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683434.060395:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683434.060652:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683434.060660:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683434.060668:0:6698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683434.060709:0:6698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683434.060715:0:6698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683434.060724:0:6698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683434.060739:0:6698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:0.0:1789683434.060743:0:6698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789683434.060749:0:6698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683434.060770:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f93ff93a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6698 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683434.061051:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:11617:x1876618802989568:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 799us (997us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789683434.061060:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 234 00000040:00080000:0.0:1789683434.061208:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683434.061214:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683434.061722:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789683434.061731:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683434.066001:0:7627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802989312 00000100:00100000:1.0:1789683434.066024:0:7627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802989312 00000100:00100000:1.0:1789683434.066114:0:7627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1789683434.066127:0:7627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:2354:x1876618802989312:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683434.066145:0:7627:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683434.066175:0:7627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ff92c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f037e expref: 29 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683434.066195:0:7627:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683434.066202:0:7627:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683434.066272:0:7627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:2354:x1876618802989312:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 147us (8157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683434.066280:0:7627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1789683434.073660:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683434.074031:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802989824 00000100:00100000:1.0:1789683434.074045:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802989824 00000100:00100000:1.0:1789683434.074118:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:1.0:1789683434.074131:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+28:11617:x1876618802989824:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789683434.074463:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:11617:x1876618802989824:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 334us (816us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1789683434.074482:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 64 00000100:00100000:0.0:1789683434.977424:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683434.977454:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815556736:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683434.977548:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683434.977765:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815556736 00000100:00100000:3.0:1789683434.977777:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815556736 00000100:00100000:3.0:1789683434.977867:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789683434.977880:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876618815556736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683434.977933:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683434.977986:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1876618815556736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683434.977994:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:0.0:1789683434.978589:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683434.978645:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c162300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815556736:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789683435.039895:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683435.949179:0:12614:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789683435.949190:0:12614:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683435.949240:0:12614:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789683435.949247:0:12614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789683436.070500:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683436.125432:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683436.131116:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802990080 00000100:00100000:2.0:1789683436.131140:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802990080 00000100:00100000:2.0:1789683436.131233:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00100000:2.0:1789683436.131254:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+29:11638:x1876618802990080:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683436.131299:0:9827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683436.131326:0:9827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff941 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0385 expref: -99 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683436.131454:0:9827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff948 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683436.131470:0:9827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683436.131483:0:9827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff948 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683436.131496:0:9827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789683436.131652:0:9827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908000/0x59bee33f93ff941 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0385 expref: 32 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683436.131715:0:9827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff948 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0385 expref: 31 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683436.131725:0:9827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:2.0:1789683436.131728:0:9827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789683436.131733:0:9827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909400, rc 0) 00000100:00100000:2.0:1789683436.131825:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11638:x1876618802990080:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 574us (6407us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789683436.131834:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 235 00000100:00080000:0.0:1789683436.134009:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683436.143961:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683436.145488:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802990208 00000100:00100000:3.0:1789683436.145508:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802990208 00000100:00100000:3.0:1789683436.145609:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 236 00000100:00100000:3.0:1789683436.145622:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11638:x1876618802990208:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:3.0:1789683436.145754:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683436.145780:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683436.145795:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683436.145842:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683436.145851:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683436.145859:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683436.145866:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683436.145879:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683436.145889:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683436.145904:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:3.0:1789683436.145908:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683436.145913:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683436.145920:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9c00/0x59bee33f93ff956 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5829 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683436.146035:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c173b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+31:11638:x1876618802990208:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 414us (2087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683436.146042:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 236 00000100:00100000:2.0:1789683436.278628:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683436.278890:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802990336 00000100:00100000:0.0:1789683436.278903:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802990336 00000100:00100000:0.0:1789683436.279277:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00100000:0.0:1789683436.279289:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802990336:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:0.0:1789683436.279319:0:6677:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683436.279350:0:6677:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff95d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f038c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789683436.279383:0:6677:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aac66e9, atime: 0x6aac66e8, ctime: 0x6aac66e9, blocks: 0xb 00010000:00010000:0.0:1789683436.279408:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=369s v=(0 0) 00010000:00010000:0.0:1789683436.279414:0:6677:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683436.279424:0:6677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff95d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f038c expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683436.279445:0:6677:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff95d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f038c expref: 8 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683436.279461:0:6677:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f200, rc 0) 00000100:00100000:0.0:1789683436.279535:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802990336:12345-192.168.203.60@tcp:101:cat.0 Request processed in 248us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683436.279542:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 71 00000100:00080000:2.0:1789683436.279705:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683436.285241:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683436.285331:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802990464 00000100:00100000:2.0:1789683436.285345:0:6681:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802990464 00002000:00100000:2.0:1789683436.285407:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8dbe76be2a00 x1876618802990464/t0(0) o3->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:492/0 lens 488/0 e 0 to 0 dl 1789683447 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789683436.285417:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe76be2a00 with x1876618802990464 ext(0->4095) 00002000:00010000:2.0:1789683436.285423:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe76be2a00 00000100:00100000:2.0:1789683436.285458:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1789683436.285468:0:6681:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802990464:12345-192.168.203.60@tcp:3:cat.0 00000100:00100000:2.0:1789683436.286064:0:6681:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+8:2353:x1876618802990464:12345-192.168.203.60@tcp:3:cat.0 Request processed in 592us (829us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1789683436.286074:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00002000:00100000:2.0:1789683436.286082:0:6681:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8dbe76be2a00 x1876618802990464/t0(0) o3->54d6ac2c-8152-4eed-adb8-5b5d9e80a202@192.168.203.60@tcp:492/0 lens 488/4536 e 0 to 0 dl 1789683447 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789683436.286090:0:6681:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8dbe76be2a00 with x1876618802990464 ext(0->4095) 00002000:00010000:2.0:1789683436.286095:0:6681:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8dbe76be2a00 00000100:00100000:0.0:1789683436.707989:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683436.708049:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683436.708092:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683436.708218:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802990848 00000100:00100000:1.0:1789683436.708232:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802990848 00000100:00100000:1.0:1789683436.708333:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 180 00000100:00100000:2.0:1789683436.708343:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802990592 00000100:00100000:1.0:1789683436.708347:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802990848:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683436.708351:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802990592 00000100:00100000:2.0:1789683436.708395:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 307 00000100:00100000:2.0:1789683436.708405:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802990592:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683436.708465:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802990848:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 120us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683436.708466:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53159050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802990592:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 60us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683436.708484:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 307 00000100:00100000:1.0:1789683436.708484:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 180 00000100:00100000:3.0:1789683436.709012:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802990720 00000100:00100000:3.0:1789683436.709019:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802990720 00000100:00100000:3.0:1789683436.709069:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00100000:3.0:1789683436.709078:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802990720:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683436.709130:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802990720:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 54us (1037us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683436.709137:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 89 00000100:00080000:0.0:1789683436.709895:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683436.709903:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683437.025439:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815557248:0@lo:400:kworker.0 00000100:00100000:1.0:1789683437.025717:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815557120:0@lo:400:kworker.0 00000100:00100000:1.0:1789683437.025919:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683437.026029:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815557120 00000100:00100000:1.0:1789683437.026040:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815557120 00000100:00100000:1.0:1789683437.026111:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789683437.026124:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815557120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683437.026190:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c162300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815557120:12345-0@lo:400:kworker.0 Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683437.026198:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1789683437.026227:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683437.026263:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c172680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815557120:0@lo:400:kworker.0 00000100:00100000:2.0:1789683437.026387:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683437.026694:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815556992:0@lo:400:kworker.0 00000100:00100000:0.0:1789683437.026896:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683437.026927:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815557504:0@lo:400:kworker.0 00000100:00100000:0.0:1789683437.026953:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683437.026994:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789683437.027001:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815556864:0@lo:400:kworker.0 00000100:00100000:0.0:1789683437.027033:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683437.027057:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815557376:0@lo:400:kworker.0 00000100:00100000:0.0:1789683437.027095:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683437.027126:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815556864 00000100:00100000:0.0:1789683437.027133:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815556864 00000100:00100000:0.0:1789683437.027168:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789683437.027175:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815556864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683437.027217:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5315a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815556864:12345-0@lo:400:kworker.0 Request processed in 42us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683437.027223:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789683437.027262:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c172d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815556864:0@lo:400:kworker.0 00000100:00100000:1.0:1789683437.027363:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815557248 00000100:00100000:1.0:1789683437.027367:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815557248 00000100:00100000:1.0:1789683437.027408:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815557504 00000100:00100000:1.0:1789683437.027411:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815557504 00000100:00100000:1.0:1789683437.027429:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789683437.027435:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815557248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683437.027497:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815557248:12345-0@lo:400:kworker.0 Request processed in 63us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683437.027504:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789683437.027646:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789683437.027653:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1876618815557504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683437.027846:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3303:x1876618815557504:12345-0@lo:400:kworker.0 Request processed in 193us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683437.027854:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789683437.027895:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c171500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815557248:0@lo:400:kworker.0 00000100:00100000:1.0:1789683437.027921:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815556992 00000100:00100000:1.0:1789683437.027925:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815556992 00000100:00100000:1.0:1789683437.027949:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815557376 00000100:00100000:1.0:1789683437.027952:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815557376 00000100:00100000:1.0:1789683437.027974:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789683437.027980:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815556992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683437.028013:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815556992:12345-0@lo:400:kworker.0 Request processed in 34us (1266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683437.028019:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1789683437.028028:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789683437.028033:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815557376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683437.028055:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815557376:12345-0@lo:400:kworker.0 Request processed in 23us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683437.028060:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:0.0:1789683437.028426:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683437.028432:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683437.028434:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683437.028467:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815557376:0@lo:400:kworker.0 00000004:00080000:2.0:1789683437.028733:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370660058543ns, next at 371660055307ns, rc = 0 00000100:00100000:0.0:1789683437.028950:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c173100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815556992:0@lo:400:kworker.0 00000100:00100000:0.0:1789683437.028974:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815557504:0@lo:400:kworker.0 00000100:00100000:3.0:1789683437.029043:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683437.029059:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815557632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683437.029123:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683437.029761:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815557632 00000100:00100000:0.0:1789683437.029770:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815557632 00000100:00100000:0.0:1789683437.029837:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789683437.029848:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815557632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683437.029896:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683437.029968:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3305:x1876618815557632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683437.029993:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789683437.030778:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815557632:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789683437.088317:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789683437.650087:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:3.0:1789683437.650118:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1789683438.116990:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789683438.175921:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:1.0:1789683438.175941:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1789683438.175965:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1789683438.175995:0:5851:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8dbe48c8e0c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789683438.176001:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe7c403200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe48c8e6c0 00000020:00080000:1.0:1789683438.176005:0:5851:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8dbe7c403400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8dbe76116800 00000004:00080000:1.0:1789683438.176021:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000001:00080000:1.0:1789683438.176032:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789683438.176061:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1789683438.176332:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1789683438.180561:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:3.0:1789683438.180580:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:3.0:1789683438.180587:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:3.0:1789683438.180625:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815557760:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789683438.180757:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683438.180858:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815557760 00000100:00100000:3.0:1789683438.180868:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815557760 00000100:00100000:3.0:1789683438.180923:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683438.180933:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815557760:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789683438.181225:0:6677:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789683438.181229:0:6677:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789683433 -> 1789683433 00002000:00010000:3.0:1789683438.181232:0:6677:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1789683432 -> 1789683432 00002000:00010000:3.0:1789683438.181234:0:6677:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789683433 -> 1789683433 00002000:00010000:3.0:1789683438.181236:0:6677:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789683438.181282:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876618815557760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 350us (535us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1789683438.181291:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789683438.181341:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1789683438.181348:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe7c170a80, transno 4294967321 00000004:00080000:3.0:1789683438.181358:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1789683438.181384:0:3305:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8dbe76be1880 x1876618815557760/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789683454 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789683438.181397:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe76be1880/2, rc 0, transno 4294967324 00000100:00100000:3.0:1789683438.181403:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76be1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815557760:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1789683439.136202:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683439.201466:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789683439.201479:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789683439.201556:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789683439.201565:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789683440.099408:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815557888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683440.099506:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683440.099713:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815557888 00000100:00100000:0.0:1789683440.099723:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815557888 00000100:00100000:0.0:1789683440.099818:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683440.099831:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815557888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683440.099897:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683440.099968:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815557888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683440.099976:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789683440.100027:0:3302:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1789683440.100035:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1789683440.100062:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe7c431880, transno 4294967310 00000100:00100000:0.0:1789683440.100086:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c163480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815557888:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789683440.101010:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789683440.160135:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683441.183824:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683441.825138:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683441.825197:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683441.825231:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683441.827133:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802991104 00000100:00100000:3.0:1789683441.827153:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802991104 00000100:00100000:3.0:1789683441.827245:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:3.0:1789683441.827259:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:2353:x1876618802991104:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683441.827387:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:2353:x1876618802991104:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 131us (2263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683441.827395:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 184 00000100:00100000:3.0:1789683441.827431:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802991360 00000100:00100000:3.0:1789683441.827436:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802991360 00000100:00100000:3.0:1789683441.827469:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:3.0:1789683441.827489:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802991360:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683441.827521:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2353:x1876618802991360:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 46us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683441.827527:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00080000:3.0:1789683441.827545:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683441.827551:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683441.831262:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683441.831318:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683441.831383:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802991232 00000100:00100000:3.0:1789683441.831396:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802991232 00000100:00100000:3.0:1789683441.831471:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:3.0:1789683441.831484:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802991232:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683441.831584:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2353:x1876618802991232:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 102us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683441.831592:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00080000:3.0:1789683441.831621:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683441.836228:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802990976 00000100:00100000:2.0:1789683441.836248:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802990976 00000100:00100000:2.0:1789683441.836332:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 309 00000100:00100000:2.0:1789683441.836347:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802990976:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683441.836566:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2353:x1876618802990976:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 222us (11333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683441.836574:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 309 00000100:00100000:2.0:1789683441.837561:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802991488 00000100:00100000:2.0:1789683441.837573:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802991488 00000100:00100000:2.0:1789683441.837655:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:2.0:1789683441.837665:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802991488:12345-192.168.203.60@tcp:400:kworker.0 00000100:00080000:3.0:1789683441.837817:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683441.838029:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2353:x1876618802991488:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 364us (6709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683441.838036:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 185 00000100:00100000:3.0:1789683442.149063:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815558016:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149161:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683442.149221:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815558528:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149253:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683442.149284:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683442.149291:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe485d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815558400:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149318:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683442.149351:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815558144:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149377:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683442.149395:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815558656:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149417:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683442.149435:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789683442.149440:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815558272:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149462:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683442.149498:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815558016 00000100:00100000:3.0:1789683442.149507:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815558016 00000100:00100000:3.0:1789683442.149562:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789683442.149573:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815558016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149649:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815558016:12345-0@lo:400:kworker.0 Request processed in 78us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683442.149657:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1789683442.149726:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815558528 00000100:00100000:3.0:1789683442.149730:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815558528 00000100:00100000:3.0:1789683442.149777:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815558144 00000100:00100000:3.0:1789683442.149780:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815558144 00000100:00100000:3.0:1789683442.149800:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815558272 00000100:00100000:3.0:1789683442.149804:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815558272 00000100:00100000:3.0:1789683442.149840:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789683442.149846:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815558528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149884:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815558528:12345-0@lo:400:kworker.0 Request processed in 38us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683442.149890:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1789683442.149903:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789683442.149909:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815558144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149939:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815558144:12345-0@lo:400:kworker.0 Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683442.149945:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789683442.149957:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789683442.149963:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815558272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.149990:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815558272:12345-0@lo:400:kworker.0 Request processed in 27us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683442.149996:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1789683442.150015:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815558400 00000100:00100000:3.0:1789683442.150019:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815558400 00000100:00100000:3.0:1789683442.150045:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815558656 00000100:00100000:3.0:1789683442.150048:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815558656 00000100:00100000:3.0:1789683442.150069:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683442.150075:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815558400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.150106:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bd9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815558400:12345-0@lo:400:kworker.0 Request processed in 31us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683442.150112:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789683442.150123:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789683442.150129:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe760b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815558656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.150171:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe760b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815558656:12345-0@lo:400:kworker.0 Request processed in 42us (753us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683442.150177:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00080000:3.0:1789683442.150210:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683442.150215:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683442.150219:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683442.150267:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815558272:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.150280:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815558144:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.150290:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815558656:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.150326:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe485d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815558400:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.150334:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815558016:0@lo:400:kworker.0 00000100:00100000:3.0:1789683442.150343:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815558528:0@lo:400:kworker.0 00000100:00100000:0.0:1789683442.150495:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683442.150506:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815558784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683442.150541:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683442.150572:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815558784 00000100:00100000:0.0:1789683442.150577:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815558784 00000100:00100000:0.0:1789683442.150607:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789683442.150623:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815558784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683442.150659:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683442.150723:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815558784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683442.150729:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789683442.150799:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815558784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789683442.208337:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683442.660082:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683442.663072:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802991616 00000100:00100000:0.0:1789683442.663093:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802991616 00000100:00100000:0.0:1789683442.663196:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:0.0:1789683442.663210:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:11282:x1876618802991616:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789683442.663362:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:11282:x1876618802991616:12345-192.168.203.60@tcp:60:lhsmtool_posix.0 Request processed in 154us (3293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683442.663371:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 237 00000100:00100000:1.0:1789683442.674909:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683442.679555:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802991872 00000100:00100000:3.0:1789683442.679577:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802991872 00000100:00100000:3.0:1789683442.679648:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 65 00000100:00100000:3.0:1789683442.679663:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:11282:x1876618802991872:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789683442.685363:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c173100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:11282:x1876618802991872:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 5687us (10453us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1789683442.685379:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 65 00010000:00010000:3.0:1789683443.242219:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789683443.246350:0:5851:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1789683443.246377:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1789683443.246398:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1789683443.246409:0:5862:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:3.0:1789683443.286082:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:0.0:1789683444.256162:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683445.197211:0:12819:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:17:23 (1789683443) 00000100:00100000:0.0:1789683445.216218:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683445.216250:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815558912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683445.216341:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683445.216489:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815558912 00000100:00100000:1.0:1789683445.216501:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815558912 00000100:00100000:1.0:1789683445.216581:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789683445.216592:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815558912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683445.216647:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683445.216752:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815558912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 161us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683445.216760:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789683445.216843:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c171c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815558912:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789683445.216943:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789683445.290403:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683446.334981:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683446.948619:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683446.948664:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683446.948737:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683446.948761:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683446.948786:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683446.948811:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802992000 00000100:00100000:1.0:1789683446.948820:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802992000 00000100:00100000:1.0:1789683446.948872:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 311 00000100:00100000:1.0:1789683446.948882:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802992000:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683446.948950:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802992000:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 68us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683446.948957:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 311 00000100:00100000:1.0:1789683446.948990:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802992384 00000100:00100000:1.0:1789683446.948994:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802992384 00000100:00100000:1.0:1789683446.949040:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802992256 00000100:00100000:1.0:1789683446.949044:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802992256 00000100:00100000:1.0:1789683446.949067:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:1.0:1789683446.949073:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2355:x1876618802992384:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683446.949102:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2355:x1876618802992384:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683446.949109:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:1.0:1789683446.949120:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1789683446.949126:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802992256:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683446.949147:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c172d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2355:x1876618802992256:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 22us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683446.949160:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1789683446.949177:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802992128 00000100:00100000:1.0:1789683446.949180:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802992128 00000100:00100000:1.0:1789683446.949201:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802992512 00000100:00100000:1.0:1789683446.949203:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802992512 00000100:00100000:2.0:1789683446.949336:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00100000:2.0:1789683446.949345:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:2355:x1876618802992128:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683446.949380:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c171c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:2355:x1876618802992128:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683446.949385:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 189 00000100:00080000:0.0:1789683446.949505:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789683446.949510:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789683446.949520:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683446.949662:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:1.0:1789683446.949669:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802992512:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683446.949735:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c172680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2355:x1876618802992512:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 66us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683446.949741:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 190 00000100:00100000:3.0:1789683447.266301:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815559040:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.266376:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683447.266422:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815559552:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.266445:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683447.266467:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683447.266472:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815559424:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.266490:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683447.266515:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815559296:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.266540:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683447.266561:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789683447.266568:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815559168:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.266591:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683447.266613:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815559680:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.266637:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683447.266669:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815559040 00000100:00100000:3.0:1789683447.266698:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815559040 00000100:00100000:3.0:1789683447.266756:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789683447.266766:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815559040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.266821:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815559040:12345-0@lo:400:kworker.0 Request processed in 57us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683447.266829:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1789683447.266859:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815559552 00000100:00100000:3.0:1789683447.266863:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815559552 00000100:00100000:3.0:1789683447.266893:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815559296 00000100:00100000:3.0:1789683447.266896:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815559296 00000100:00100000:3.0:1789683447.266915:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815559168 00000100:00100000:3.0:1789683447.266917:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815559168 00000100:00100000:3.0:1789683447.266932:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789683447.266944:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815559552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.266977:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815559552:12345-0@lo:400:kworker.0 Request processed in 33us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683447.266982:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1789683447.266996:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789683447.267002:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815559296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.267032:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815559296:12345-0@lo:400:kworker.0 Request processed in 30us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683447.267037:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1789683447.267048:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789683447.267053:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7612aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815559168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.267072:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7612aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815559168:12345-0@lo:400:kworker.0 Request processed in 20us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683447.267077:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1789683447.267091:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815559424 00000100:00100000:3.0:1789683447.267094:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815559424 00000100:00100000:3.0:1789683447.267121:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815559680 00000100:00100000:3.0:1789683447.267123:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815559680 00000100:00100000:1.0:1789683447.267135:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe53099f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815559040:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.267142:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789683447.267150:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815559424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683447.267155:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76be0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815559552:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.267185:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76129500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815559424:12345-0@lo:400:kworker.0 Request processed in 35us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683447.267186:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76be2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815559424:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.267198:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789683447.267211:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789683447.267217:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe6fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815559680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.267240:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe6fef3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815559680:12345-0@lo:400:kworker.0 Request processed in 24us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683447.267252:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1789683447.267279:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789683447.267283:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789683447.267286:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683447.267315:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815559168:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.267324:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1789683447.267329:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe76be1880, transno 4294967324 00000100:00100000:3.0:1789683447.267351:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76129f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815559680:0@lo:400:kworker.0 00000100:00100000:3.0:1789683447.267362:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76be1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815559296:0@lo:400:kworker.0 00000100:00100000:2.0:1789683447.268544:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683447.268558:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815559808:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683447.268608:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683447.268664:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815559808 00000100:00100000:2.0:1789683447.268670:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815559808 00000100:00100000:2.0:1789683447.268858:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683447.268865:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815559808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683447.268898:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683447.268934:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815559808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683447.268941:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789683447.268980:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815559808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789683447.391804:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683447.641777:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683447.646366:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802992640 00000100:00100000:3.0:1789683447.646381:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802992640 00000100:00100000:2.0:1789683447.646868:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 238 00000100:00100000:2.0:1789683447.647056:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:12303:x1876618802992640:12345-192.168.203.60@tcp:101:lsof.0 00010000:00010000:2.0:1789683447.647081:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683447.647103:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff964 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0393 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683447.647169:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff96b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683447.647183:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff96b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683447.647194:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff96b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683447.647231:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683447.647235:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683447.647276:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff96b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683447.647320:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909e00/0x59bee33f93ff964 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0393 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683447.647338:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff96b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0393 expref: 6 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683447.647347:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:2.0:1789683447.647349:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683447.647353:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908800, rc 0) 00000100:00100000:2.0:1789683447.647488:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:12303:x1876618802992640:12345-192.168.203.60@tcp:101:lsof.0 Request processed in 608us (5717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683447.647496:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 238 00010000:00010000:1.0:1789683448.416076:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789683449.440056:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789683449.440066:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789683449.440538:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1789683449.440546:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789683449.441187:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683449.673819:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683449.673927:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802992896 00000100:00100000:1.0:1789683449.673937:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802992896 00000100:00100000:1.0:1789683449.674015:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00100000:1.0:1789683449.674039:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+18:12305:x1876618802992896:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:1.0:1789683449.674387:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:12305:x1876618802992896:12345-192.168.203.60@tcp:35:umount.0 Request processed in 362us (575us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789683449.674395:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 66 00000100:00080000:3.0:1789683449.674543:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683449.698732:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683449.698814:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802993152 00000100:00100000:2.0:1789683449.698825:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802993152 00000100:00100000:2.0:1789683449.698881:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:2.0:1789683449.698892:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+19:12305:x1876618802993152:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:2.0:1789683449.699252:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:12305:x1876618802993152:12345-192.168.203.60@tcp:35:umount.0 Request processed in 361us (527us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789683449.699260:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 67 00000100:00100000:2.0:1789683449.702060:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683449.702152:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802993408 00000100:00100000:0.0:1789683449.702177:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802993408 00000100:00100000:0.0:1789683449.702234:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:0.0:1789683449.702245:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7085fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+20:12305:x1876618802993408:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:0.0:1789683449.702471:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7085fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:12305:x1876618802993408:12345-192.168.203.60@tcp:35:umount.0 Request processed in 228us (420us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1789683449.702479:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 68 00000100:00100000:3.0:1789683449.710947:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683449.711068:0:11963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802993664 00000100:00100000:1.0:1789683449.711078:0:11963:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802993664 00000100:00100000:1.0:1789683449.711184:0:11963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:1.0:1789683449.711194:0:11963:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+21:12305:x1876618802993664:12345-192.168.203.60@tcp:35:umount.0 00000100:00100000:1.0:1789683449.711540:0:11963:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76129f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:12305:x1876618802993664:12345-192.168.203.60@tcp:35:umount.0 Request processed in 347us (603us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789683449.711548:0:11963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 69 00000100:00100000:1.0:1789683449.716924:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683449.716965:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683449.717013:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683449.717154:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802993792 00000100:00100000:3.0:1789683449.717164:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802993792 00000100:00100000:3.0:1789683449.717221:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802994048 00000100:00100000:3.0:1789683449.717225:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802994048 00000100:00100000:3.0:1789683449.717246:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802993920 00000100:00100000:3.0:1789683449.717249:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802993920 00000100:00100000:3.0:1789683449.717267:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1789683449.717275:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+15:2355:x1876618802993792:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683449.717291:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683449.717309:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e2400/0x59bee33f93fe9f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff25 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683449.717339:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683449.717392:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+14:2355:x1876618802993792:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 117us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683449.717399:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:3.0:1789683449.717418:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1789683449.717424:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+13:2355:x1876618802994048:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683449.717433:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683449.717444:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8c400/0x59bee33f93fec05 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efff0 expref: 13 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683449.717453:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683449.717471:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+12:2355:x1876618802994048:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 47us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683449.717477:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:3.0:1789683449.717491:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:3.0:1789683449.717497:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+11:2355:x1876618802993920:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683449.717507:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683449.717516:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e3800/0x59bee33f93fe957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efeed expref: 11 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683449.717526:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683449.717542:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2355:x1876618802993920:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 45us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683449.717548:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:2.0:1789683449.721916:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683449.721963:0:6674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802994432 00000100:00100000:3.0:1789683449.721989:0:6674:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802994432 00000100:00100000:3.0:1789683449.722074:0:6674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00100000:3.0:1789683449.722085:0:6674:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2351:x1876618802994432:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:3.0:1789683449.722114:0:6674:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fef31 00000020:00010000:3.0:1789683449.722121:0:6674:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8dbe76109000: total 0 00000100:00080000:3.0:1789683449.722126:0:6674:0:(import.c:65:import_set_state_nolock()) ffff8dbe7610f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683449.722180:0:6674:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:2.0:1789683449.722233:0:5817:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8dbe76109000: total 0 00010000:00010000:2.0:1789683449.722269:0:5817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dbe76109000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789683449.722320:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ff2cd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01c5 expref: 6 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683449.722374:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9dd25e8/0x59bee33f93ff95d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f038c expref: 5 pid: 6677 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683449.722390:0:5817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dbe76109000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789683449.722402:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683449.722404:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683449.722406:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683449.722786:0:6674:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+2:2351:x1876618802994432:12345-192.168.203.60@tcp:9:umount.0 Request processed in 701us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683449.722796:0:6674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 73 00000100:00080000:0.0:1789683449.723081:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683449.726890:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683449.728102:0:8465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802994560 00000100:00100000:2.0:1789683449.728115:0:8465:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802994560 00000100:00080000:0.0:1789683449.728171:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683449.728192:0:8465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:2.0:1789683449.728204:0:8465:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+5:2351:x1876618802994560:12345-192.168.203.60@tcp:9:umount.0 00000020:00000080:2.0:1789683449.728236:0:8465:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fecc9 00000100:00080000:2.0:1789683449.728246:0:8465:0:(import.c:65:import_set_state_nolock()) ffff8dbe75e5a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789683449.728279:0:8465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1789683449.728552:0:8465:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+2:2351:x1876618802994560:12345-192.168.203.60@tcp:9:umount.0 Request processed in 350us (1670us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683449.728559:0:8465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00010000:00010000:1.0:1789683449.729103:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683449.750898:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683449.750985:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802995584 00000100:00100000:3.0:1789683449.750994:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802995584 00000100:00100000:3.0:1789683449.751055:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:3.0:1789683449.751064:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+22:2351:x1876618802995584:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:3.0:1789683449.751097:0:9827:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe965 00000020:00010000:3.0:1789683449.751115:0:9827:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8dbd44c8c000: total 0 00000100:00080000:3.0:1789683449.751121:0:9827:0:(import.c:65:import_set_state_nolock()) ffff8dbd44c8a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683449.751158:0:9827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:1.0:1789683449.751598:0:5818:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8dbd44c8c000: total 0 00010000:00010000:1.0:1789683449.751643:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dbd44c8c000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789683449.751731:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:1.0:1789683449.751735:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683449.751743:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d200/0x59bee33f93ff321 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01da expref: 21 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751764:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683449.751766:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789683449.751771:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fef8c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f00ec expref: 20 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751783:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dbe60aa2100) 00010000:00010000:1.0:1789683449.751785:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683449.751789:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f600/0x59bee33f93fec2f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449efffe expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751808:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683449.751823:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789683449.751828:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ff948 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0385 expref: 18 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751842:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:1.0:1789683449.751844:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683449.751848:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8c600/0x59bee33f93ff1ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0178 expref: 17 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751859:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683449.751862:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683449.751866:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ff91e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0377 expref: 16 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751877:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8dbe60aa2b00) 00010000:00010000:1.0:1789683449.751880:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789683449.751884:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40e400/0x59bee33f93fec9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f001a expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751899:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe5931e700) 00010000:00010000:1.0:1789683449.751901:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683449.751905:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9400/0x59bee33f93fec4b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0005 expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751919:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683449.751921:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789683449.751925:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93ff61c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f02b3 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751951:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:1.0:1789683449.751954:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789683449.751958:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe59f8d000/0x59bee33f93ff2b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01be expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751971:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8dbe6097c900) 00010000:00010000:1.0:1789683449.751974:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683449.751978:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93ff83e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f033f expref: 11 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.751993:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8dbe60aa2d00) 00010000:00010000:1.0:1789683449.751996:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789683449.751999:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93ff33d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01e1 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.752013:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8dbe60aa2c00) 00010000:00010000:1.0:1789683449.752016:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789683449.752019:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe54ea9200/0x59bee33f93ff28e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f01b0 expref: 9 pid: 9827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683449.752032:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dbd44c8c000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789683449.752045:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683449.752047:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683449.752049:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683449.752850:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76be1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:54d6ac2c-8152-4eed-adb8-5b5d9e80a202+7:2351:x1876618802995584:12345-192.168.203.60@tcp:39:umount.0 Request processed in 1782us (1959us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789683449.752862:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 239 00000100:00100000:1.0:1789683450.336006:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683450.336037:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe5309ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815559936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683450.336104:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683450.337207:0:6678:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815559936 00000100:00100000:0.0:1789683450.337217:0:6678:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815559936 00000100:00100000:0.0:1789683450.337297:0:6678:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789683450.337307:0:6678:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815559936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683450.337345:0:6678:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683450.337408:0:6678:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815559936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683450.337425:0:6678:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789683450.337475:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe5309ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815559936:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789683450.337581:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789683450.466193:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683451.487970:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683452.065327:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683452.065377:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683452.065506:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802995712 00000100:00100000:2.0:1789683452.065517:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802995712 00000100:00100000:2.0:1789683452.065592:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 313 00000100:00100000:2.0:1789683452.065604:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2354:x1876618802995712:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683452.065811:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802995840 00000100:00100000:3.0:1789683452.065816:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802995840 00000100:00100000:3.0:1789683452.065860:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:3.0:1789683452.065868:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:2354:x1876618802995840:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683452.065972:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:85ca73fa-7ddf-4820-b817-0961de675c61+10:2354:x1876618802995712:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 369us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683452.065980:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 313 00000100:00080000:2.0:1789683452.066036:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683452.072000:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:2354:x1876618802995840:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 6121us (6610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683452.072015:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 194 00000100:00100000:0.0:1789683452.203826:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683452.203871:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683452.204088:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802995968 00000100:00100000:3.0:1789683452.204100:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802995968 00000100:00100000:3.0:1789683452.204164:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802996096 00000100:00100000:3.0:1789683452.204168:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802996096 00000100:00100000:3.0:1789683452.204198:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1789683452.204209:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+11:2353:x1876618802995968:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683452.204225:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683452.204243:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8ce00/0x59bee33f93fea37 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff3a expref: 11 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683452.204272:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683452.204323:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+10:2353:x1876618802995968:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 115us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683452.204340:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:3.0:1789683452.204358:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1789683452.204365:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+9:2353:x1876618802996096:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683452.204376:0:5814:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683452.204385:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7c40f400/0x59bee33f93fea3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff64 expref: 9 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683452.204398:0:5814:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683452.204420:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:85ca73fa-7ddf-4820-b817-0961de675c61+8:2353:x1876618802996096:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 56us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683452.204442:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1789683452.205533:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683452.207309:0:11663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802996224 00000100:00100000:1.0:1789683452.207324:0:11663:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802996224 00000100:00100000:1.0:1789683452.207402:0:11663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1789683452.207412:0:11663:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe496e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:85ca73fa-7ddf-4820-b817-0961de675c61+8:2353:x1876618802996224:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683452.207428:0:11663:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683452.207446:0:11663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7c40ea00/0x59bee33f93febfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449effe9 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683452.207462:0:11663:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683452.207525:0:11663:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe496e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:85ca73fa-7ddf-4820-b817-0961de675c61+7:2353:x1876618802996224:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 114us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683452.207531:0:11663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1789683452.210368:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683452.210488:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802996480 00000100:00100000:3.0:1789683452.210497:0:5830:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802996480 00000100:00100000:3.0:1789683452.210559:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 240 00000100:00100000:3.0:1789683452.210570:0:5830:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5309ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+6:2351:x1876618802996480:12345-192.168.203.60@tcp:39:umount.0 00000020:00000080:3.0:1789683452.210611:0:5830:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fea4c 00000020:00010000:3.0:1789683452.210620:0:5830:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8dbe75e1c000: total 0 00000100:00080000:3.0:1789683452.210625:0:5830:0:(import.c:65:import_set_state_nolock()) ffff8dbd44c98000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789683452.210658:0:5830:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1789683452.212004:0:5830:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5309ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:234683c5-3d03-46f5-a4e7-feef99fc60e0+5:2351:x1876618802996480:12345-192.168.203.60@tcp:39:umount.0 Request processed in 625us (834us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1789683452.212022:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 240 00000020:00010000:1.0:1789683452.212936:0:5818:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8dbe75e1c000: total 0 00010000:00010000:1.0:1789683452.212943:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683452.212994:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dbe75e1c000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1789683452.213026:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:1.0:1789683452.213031:0:5818:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789683452.213040:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ff96b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0393 expref: 4 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683452.213063:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dbe75e1c000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1789683452.213074:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683452.213076:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683452.213078:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683452.247224:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683452.247405:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802996736 00000100:00100000:3.0:1789683452.247415:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802996736 00000100:00100000:3.0:1789683452.247524:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 314 00000100:00100000:3.0:1789683452.247535:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+7:2351:x1876618802996736:12345-192.168.203.60@tcp:251:umount.0 00000020:00000080:3.0:1789683452.247582:0:5821:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe942 00000020:00010000:3.0:1789683452.247590:0:5821:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8dbd44c9d800: total 0 00000100:00080000:3.0:1789683452.247595:0:5821:0:(import.c:65:import_set_state_nolock()) ffff8dbd44c98800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789683452.247717:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:85ca73fa-7ddf-4820-b817-0961de675c61+3:2351:x1876618802996736:12345-192.168.203.60@tcp:251:umount.0 Request processed in 183us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683452.247724:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 314 00000020:00010000:2.0:1789683452.252272:0:5817:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8dbd44c9d800: total 0 00010000:00010000:2.0:1789683452.252334:0:5817:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dbd44c9d800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789683452.252373:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8cc00/0x59bee33f93fe9f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449eff2c expref: 2 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683452.252392:0:5817:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dbd44c9d800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789683452.252401:0:5817:0:(genops.c:885:class_export_put()) final put ffff8dbd44c9d800/85ca73fa-7ddf-4820-b817-0961de675c61 00010000:00010000:2.0:1789683452.252422:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683452.252425:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683452.252426:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789683452.252596:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44c9d800/85ca73fa-7ddf-4820-b817-0961de675c61 for MGS 00000020:00000080:0.0:1789683452.252653:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbd44c98800 for MGS 00000100:00100000:2.0:1789683452.383958:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815560192:0@lo:400:kworker.0 00000100:00100000:2.0:1789683452.384041:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683452.384112:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c11ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815560704:0@lo:400:kworker.0 00000100:00100000:2.0:1789683452.384137:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683452.384176:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683452.384182:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815560320:0@lo:400:kworker.0 00000100:00100000:2.0:1789683452.384201:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683452.384230:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815560192 00000100:00100000:2.0:1789683452.384238:0:5829:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815560192 00000100:00100000:1.0:1789683452.384383:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815560704 00000100:00100000:0.0:1789683452.384409:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815560832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683452.384412:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815560704 00000100:00100000:0.0:1789683452.384451:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683452.384470:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789683452.384483:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c11a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815560704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.384540:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c11a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815560704:12345-0@lo:400:kworker.0 Request processed in 61us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683452.384547:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:0.0:1789683452.384559:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789683452.384576:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815560064:0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.384580:0:6679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815560832 00000100:00100000:1.0:1789683452.384586:0:6679:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815560832 00000100:00100000:1.0:1789683452.384618:0:6679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789683452.384624:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683452.384629:0:6679:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815560832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683452.384657:0:6679:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683452.384708:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c11a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815560576:0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.384736:0:6679:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815560832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683452.384744:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683452.384748:0:6679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789683452.384771:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683452.384779:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815560448:0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.384802:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815560832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683452.384808:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683452.384849:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815560320 00000100:00100000:1.0:1789683452.384853:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815560320 00000100:00100000:1.0:1789683452.384890:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815560576 00000100:00100000:1.0:1789683452.384893:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815560576 00000100:00100000:1.0:1789683452.384913:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789683452.384920:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815560320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.384951:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815560320:12345-0@lo:400:kworker.0 Request processed in 32us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683452.384957:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1789683452.384969:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789683452.384975:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815560576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.385005:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876618815560576:12345-0@lo:400:kworker.0 Request processed in 31us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683452.385017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789683452.385052:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c11a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876618815560576:0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.385086:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76137800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815560320:0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.385096:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c11ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815560704:0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.385120:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815560064 00000100:00100000:1.0:1789683452.385124:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815560064 00000100:00100000:1.0:1789683452.385148:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789683452.385155:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815560064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683452.385193:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe485e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3303:x1876618815560064:12345-0@lo:400:kworker.0 Request processed in 38us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683452.385199:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:1.0:1789683452.385231:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815560064:0@lo:400:kworker.0 00000100:00080000:0.0:1789683452.385480:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683452.385665:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1789683452.385703:0:5829:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815560192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683452.385758:0:5829:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c119f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815560192:12345-0@lo:400:kworker.0 Request processed in 86us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683452.385764:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789683452.385993:0:6677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815560448 00000100:00100000:3.0:1789683452.385999:0:6677:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815560448 00000100:00100000:3.0:1789683452.386041:0:6677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789683452.386049:0:6677:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815560448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683452.386095:0:6677:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815560448:12345-0@lo:400:kworker.0 Request processed in 48us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683452.386113:0:6677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789683452.386251:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815560192:0@lo:400:kworker.0 00000100:00080000:2.0:1789683452.386473:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789683452.386557:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815560448:0@lo:400:kworker.0 00010000:00010000:1.0:1789683452.515956:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789683452.962269:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:3.0:1789683452.962278:0:6700:0:(genops.c:885:class_export_put()) final put ffff8dbe75e5c800/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:3.0:1789683452.962312:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe75e5c800/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 for lustre-OST0000 00000020:00000080:3.0:1789683452.962354:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe75e5a000 for lustre-OST0000 00000001:00080000:1.0:1789683453.485170:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00080000:1.0:1789683453.485186:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1789683453.485199:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 234683c5-3d03-46f5-a4e7-feef99fc60e0 00000001:00080000:1.0:1789683453.485205:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789683453.485208:0:5851:0:(genops.c:885:class_export_put()) final put ffff8dbe75e1c000/234683c5-3d03-46f5-a4e7-feef99fc60e0 00000001:00100000:1.0:1789683453.485224:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000001:00080000:1.0:1789683453.485229:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789683453.485230:0:5851:0:(genops.c:885:class_export_put()) final put ffff8dbd44c8c000/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:3.0:1789683453.487209:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe75e1c000/234683c5-3d03-46f5-a4e7-feef99fc60e0 for lustre-MDT0000 00000020:00000080:3.0:1789683453.487331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44c8c000/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 for lustre-MDT0000 00000020:00000080:3.0:1789683453.487366:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbd44c98000 for lustre-MDT0000 00000020:00000080:3.0:1789683453.487370:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbd44c8a000 for lustre-MDT0000 00000001:00100000:3.0:1789683453.500819:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:3.0:1789683453.500828:0:7641:0:(genops.c:885:class_export_put()) final put ffff8dbe76109000/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 00000020:00000080:1.0:1789683453.501333:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe76109000/54d6ac2c-8152-4eed-adb8-5b5d9e80a202 for lustre-OST0001 00000020:00000080:1.0:1789683453.501385:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe7610f800 for lustre-OST0001 00010000:00010000:1.0:1789683453.542375:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789683454.483813:0:13017:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1789683454.506946:0:13017:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789683454.507001:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.507017:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.507025:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.507033:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.507057:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789683454.507063:0:13017:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789683454.507099:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683454.507104:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789683454.507109:0:13017:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789683454.507137:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8dbe6fee8000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789683454.507285:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815560960:0@lo:39:umount.0 00000100:00100000:0.0:1789683454.507347:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683454.507458:0:9827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815560960 00000100:00100000:1.0:1789683454.507466:0:9827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815560960 00000100:00100000:1.0:1789683454.507514:0:9827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789683454.507522:0:9827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876618815560960:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789683454.507547:0:9827:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe751 00000100:00080000:1.0:1789683454.507555:0:9827:0:(import.c:65:import_set_state_nolock()) ffff8dbe75e1f000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789683454.507621:0:9827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3301:x1876618815560960:12345-0@lo:39:umount.0 Request processed in 100us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683454.507638:0:9827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1789683454.507646:0:9827:0:(genops.c:885:class_export_put()) final put ffff8dbe6fe18800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1789683454.507785:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683454.507792:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.507801:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3200 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683454.507805:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.507814:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683454.507821:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683454.507827:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789683454.507829:0:7626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789683454.507832:0:7626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789683454.507854:0:7626:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.507878:0:7626:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683454.507907:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.507913:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3200/0x59bee33f93fe9c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe9ce expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.507924:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683454.507926:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683454.507927:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789683454.507938:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe6fe18800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789683454.507981:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe75e1f000 for lustre-MDT0000 00000100:00080000:0.0:1789683454.508013:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe6fee8000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789683454.508021:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815560960:0@lo:39:umount.0 00000100:00100000:3.0:1789683454.508042:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815561088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683454.508076:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683454.508127:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789683454.508132:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789683454.508136:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1789683454.508178:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815561088 00000100:00100000:0.0:1789683454.508183:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815561088 00000100:00100000:0.0:1789683454.508259:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683454.508266:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+19:3302:x1876618815561088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683454.508277:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683454.508289:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea9800/0x59bee33f93fe9ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe9c7 expref: 19 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.508301:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683454.508334:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+18:3302:x1876618815561088:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683454.508340:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1789683454.508403:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683454.509009:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815561088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683454.509037:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509049:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509057:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509063:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509081:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683454.509086:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509093:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509100:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509114:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683454.509115:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683454.509124:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683454.509133:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8000 already unused, calling callback (ffffffffc1b9ec20) 00010000:00010000:3.0:1789683454.509138:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683454.509146:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509153:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509159:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509165:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509185:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789683454.509190:0:13017:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509197:0:13017:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509202:0:13017:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509209:0:13017:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683454.509228:0:13017:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:3.0:1789683454.509231:0:13017:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789683454.509250:0:13017:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789683454.509254:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789683454.509258:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683454.509263:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1789683454.509268:0:13017:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8dbd45456800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683454.509274:0:13017:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8dbe7bc47000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789683454.509278:0:13017:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8dbe48a419c0) has exports, disconnecting them 00000020:00080000:3.0:1789683454.509282:0:13017:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dbd45456800), last request at 1789683452 00000020:00000080:3.0:1789683454.509288:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe8c4 00000100:00080000:3.0:1789683454.509302:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8dbd45455800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789683454.509337:0:13017:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dbd45456800): rc 0 00000020:00000080:3.0:1789683454.509339:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbd45456800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789683454.509347:0:13017:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8dbe7bc47000), last request at 1789683452 00000020:00000080:3.0:1789683454.509351:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe7f9 00000100:00080000:3.0:1789683454.509357:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bc42800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789683454.509364:0:13017:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dbe7bc47000): rc 0 00000020:00000080:3.0:1789683454.509365:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe7bc47000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1789683454.509371:0:13017:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9e3e4157fae0 00000100:00080000:3.0:1789683454.509389:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789683454.509393:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1789683454.509404:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789683454.509464:0:13017:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789683454.509483:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8dbe53b2c000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789683454.509493:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789683454.509495:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1789683454.509508:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1789683454.509566:0:13017:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789683454.509577:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bfba800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1789683454.509603:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8dbe48a419c0) has no exports 00010000:00010000:2.0:1789683454.509658:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789683454.509663:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509701:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8d800 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683454.509705:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509713:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683454.509720:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683454.509726:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1789683454.509728:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1789683454.509730:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789683454.509750:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509757:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683454.509774:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509781:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d800/0x59bee33f93fe8fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe903 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509795:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683454.509798:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509804:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe59f8de00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683454.509813:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509820:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683454.509826:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683454.509830:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789683454.509832:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789683454.509834:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789683454.509848:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509853:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683454.509869:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509875:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8de00/0x59bee33f93febf0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93febf7 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509883:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683454.509886:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509891:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44431400 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683454.509894:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509900:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683454.509913:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683454.509918:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1789683454.509920:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1789683454.509922:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1789683454.509934:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509939:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683454.509945:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509951:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe44431400/0x59bee33f93fe6b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe6b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.509963:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683454.509965:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683454.509966:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683454.510027:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815561472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683454.510080:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683454.512220:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815561472 00000100:00100000:2.0:1789683454.512238:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815561472 00000100:00100000:2.0:1789683454.512306:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683454.512318:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+18:3303:x1876618815561472:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683454.512328:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815561600:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683454.512333:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683454.512350:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe4583b400/0x59bee33f93fe903 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe8fc expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.512371:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683454.512395:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683454.512426:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+17:3303:x1876618815561472:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (2343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683454.512443:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683454.512448:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683454.512452:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815561728:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683454.512466:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815561600 00000100:00100000:2.0:1789683454.512472:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815561600 00000100:00100000:0.0:1789683454.512483:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1789683454.512518:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683454.512530:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683454.512537:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683454.512543:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683454.512546:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:1.0:1789683454.512549:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00100000:2.0:1789683454.513739:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815561728 00000100:00100000:2.0:1789683454.513749:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815561728 00000100:00100000:2.0:1789683454.513784:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683454.513792:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+18:3304:x1876618815561600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683454.513803:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683454.513815:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7c40e000/0x59bee33f93febf7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93febf0 expref: 18 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.513828:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683454.513871:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+17:3304:x1876618815561600:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (1478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683454.513877:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683454.513891:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683454.513896:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+16:3304:x1876618815561728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683454.513904:0:5815:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683454.513911:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e3a00/0x59bee33f93fe6b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe6b0 expref: 16 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683454.513922:0:5815:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683454.513938:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:08ddc492-5684-492d-ac6b-b8fd660301db+15:3304:x1876618815561728:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683454.513944:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683454.513980:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815561472:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683454.515574:0:5818:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683454.515612:0:5818:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789683454.515641:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683454.515650:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93fe9d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe9dc expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683454.515687:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683454.515691:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683454.515692:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789683454.515861:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd45456800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789683454.515921:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7bc47000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789683454.515947:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbd45455800 for lustre-MDT0000 00000020:00000080:0.0:1789683454.515952:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe7bc42800 for lustre-MDT0000 00000100:00100000:0.0:1789683454.515976:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815561856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683454.516033:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789683454.516085:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683454.516097:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815561856 00000100:00100000:0.0:1789683454.516104:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815561856 00000100:00100000:0.0:1789683454.516162:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683454.516170:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+15:3302:x1876618815561856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683454.516180:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683454.516194:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe4583ae00/0x59bee33f93fe9dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe9d5 expref: 15 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.516208:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683454.516241:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:08ddc492-5684-492d-ac6b-b8fd660301db+14:3302:x1876618815561856:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683454.516248:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683454.516286:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815561856:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683454.516307:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815561216:0@lo:9:umount.0 00000100:00100000:0.0:1789683454.516342:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683454.516364:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815561344:0@lo:9:umount.0 00000100:00100000:0.0:1789683454.516384:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683454.516411:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815561216 00000100:00100000:0.0:1789683454.516415:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815561216 00000100:00100000:0.0:1789683454.516450:0:6676:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815561344 00000100:00100000:0.0:1789683454.516453:0:6676:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815561344 00000100:00100000:0.0:1789683454.516474:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789683454.516481:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876618815561216:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789683454.516506:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe846 00000100:00080000:0.0:1789683454.516516:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bc44800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683454.516549:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1789683454.517286:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3301:x1876618815561216:12345-0@lo:9:umount.0 Request processed in 804us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683454.517294:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789683454.517309:0:6676:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789683454.517316:0:6676:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3301:x1876618815561344:12345-0@lo:9:umount.0 00000020:00000080:0.0:1789683454.517328:0:6676:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe934 00000100:00080000:0.0:1789683454.517334:0:6676:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9eb000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789683454.517352:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1789683454.517536:0:6676:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3301:x1876618815561344:12345-0@lo:9:umount.0 Request processed in 220us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683454.517543:0:6676:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1789683454.517567:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683454.517570:0:5824:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789683454.517755:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789683454.518314:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe53b2c000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789683454.518376:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000100:00100000:3.0:1789683454.520030:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815561728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683454.520044:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:08ddc492-5684-492d-ac6b-b8fd660301db:3304:1876618815561600:0@lo:103:ldlm_bl.0 00000004:00080000:0.0:1789683454.521440:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789683454.521470:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b919f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815561216:0@lo:9:umount.0 00000100:00080000:0.0:1789683454.521505:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bfba800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789683454.521590:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789683454.521593:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789683454.521596:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b919500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815561344:0@lo:9:umount.0 00010000:00010000:0.0:1789683454.521646:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789683454.537263:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8dbe48a419c0) has no exports 00010000:00010000:0.0:1789683454.561831:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789683454.618974:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe70b 00000020:00000080:3.0:1789683454.618991:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe7b95f000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789683454.619068:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789683454.620832:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683454.620859:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789683454.620863:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8dbe7d643380) has no exports 00000020:00000080:2.0:1789683454.623420:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe704 00000020:00000080:1.0:1789683454.623422:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7b95f000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1789683454.623433:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe7d648000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683454.623474:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7d648000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789683454.623504:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683454.623515:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789683454.623517:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe7c572800/lustre-QMT0000_UUID 00000020:00000080:2.0:1789683454.623520:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7c572800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789683454.623530:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1789683454.623706:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dbe7c4022a0 - data ffff8dbe4e7be798/ffff8dbe76c82c00 00000020:01000000:0.0:1789683454.623919:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dbe76266720 - data ffff8dbe4f510438/ffff8dbe7bea8000 00000001:00000004:0.0:1789683454.637808:0:13017:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1789683454.761977:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789683454.761986:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1789683454.761996:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683454.761998:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789683454.762589:0:6774:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789683454.762596:0:6774:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1789683454.762605:0:6774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1789683454.763746:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789683454.763752:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1789683454.763771:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789683454.763773:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789683454.764344:0:8088:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789683454.764350:0:8088:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1789683454.764361:0:8088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1789683454.843932:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe6d3 00000020:00000080:1.0:1789683454.843946:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe75e1a000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789683454.844758:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe75e1a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789683454.847307:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe6e8 00000020:00000080:1.0:1789683454.847325:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe7c570800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789683454.847346:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789683454.847352:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683454.847360:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789683454.847364:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8dbe48a43380) has no exports 00000004:01000000:1.0:1789683454.847537:0:13017:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789683454.847547:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe926 00000020:00000080:1.0:1789683454.847551:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe7bfbe000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789683454.847555:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789683454.847559:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683454.847564:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789683454.847580:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8dbe484899c0) has no exports 00000020:00000080:1.0:1789683454.847587:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe91f 00000020:00000080:1.0:1789683454.847591:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe7bfbf000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789683454.847977:0:13017:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789683454.847982:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789683454.847987:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1789683454.847993:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789683454.847996:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789683454.848025:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683454.848033:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683454.848039:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe83f 00000020:00000080:1.0:1789683454.848043:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe5ba79000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789683454.848049:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789683454.848053:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683454.848056:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789683454.848058:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8dbe4848cd40) has no exports 00000020:00000080:1.0:1789683454.848062:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe838 00000020:00000080:1.0:1789683454.848065:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe53b2f800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1789683454.848362:0:13017:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789683454.848365:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789683454.848367:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1789683454.848370:0:13017:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789683454.848372:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789683454.848396:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683454.848401:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683454.848424:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683454.848426:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683454.848453:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe6ef 00000020:00000080:1.0:1789683454.848457:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe7c573000/lustre-MDD0000_UUID 00000020:01000000:1.0:1789683454.848462:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1789683454.848465:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683454.848468:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789683454.848476:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8dbe48a40000) has no exports 00000020:00000080:1.0:1789683454.848493:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683454.848497:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1789683454.848500:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe6f6 00000020:00000080:1.0:1789683454.848503:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe7c576000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789683454.848510:0:13017:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dbe46fc8800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1789683454.848513:0:13017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe46fc8800 3 00000020:01000004:1.0:1789683454.848516:0:13017:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dbe46fc8800 from lustre-MDT0000 00000020:00000080:1.0:1789683454.848532:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683454.848535:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1789683454.848538:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe75e1c800/lustre-MDT0000_UUID 00000020:00000080:1.0:1789683454.848540:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe75e1c800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1789683454.848548:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1789683454.848610:0:13017:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1789683454.848614:0:13017:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1789683454.848617:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1789683454.848620:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683454.848622:0:13017:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789683454.848628:0:13017:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8dbe52ff9800 08ddc492-5684-492d-ac6b-b8fd660301db 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789683454.848633:0:13017:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8dbe48c619c0) has exports, disconnecting them 00000020:00080000:1.0:1789683454.848638:0:13017:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8dbe52ff9800), last request at 1789683211 00000020:00000080:1.0:1789683454.848653:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe694 00000020:00010000:1.0:1789683454.848656:0:13017:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8dbe52ff9800: total 7 00000100:00080000:1.0:1789683454.848661:0:13017:0:(import.c:65:import_set_state_nolock()) ffff8dbe52ff8800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1789683454.851789:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7c570800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:2.0:1789683454.851803:0:37:0:(genops.c:885:class_export_put()) final put ffff8dbe75e1e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789683454.851806:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe75e1e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1789683454.851814:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789683454.851972:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7bfbe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789683454.851979:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7bfbf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789683454.851986:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe7bfba800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1789683454.851992:0:37:0:(genops.c:885:class_export_put()) final put ffff8dbd46e2c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789683454.851994:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd46e2c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1789683454.851997:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789683454.852026:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe5ba79000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789683454.852043:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe53b2f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789683454.852048:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe53b2c000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1789683454.852052:0:37:0:(genops.c:885:class_export_put()) final put ffff8dbd44c88800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789683454.852054:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44c88800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1789683454.852057:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789683454.852123:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7c573000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1789683454.852127:0:37:0:(genops.c:885:class_export_put()) final put ffff8dbe7c577800/lustre-MDD0000_UUID 00000020:00000080:2.0:1789683454.852129:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7c577800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1789683454.852133:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1789683454.852292:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7c576000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:1.0:1789683454.854827:0:13017:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dbe52ff9800): rc 0 00000020:00080000:1.0:1789683454.854836:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8dbe48c619c0) has no exports 00000020:00010000:0.0:1789683454.854915:0:5818:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8dbe52ff9800: total 0 00010000:00010000:0.0:1789683454.854965:0:5818:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8dbe52ff9800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789683454.854992:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea8c00/0x59bee33f93fe7ac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe7a5 expref: 9 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.855013:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe4583a400/0x59bee33f93fe9ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe9e3 expref: 8 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.855025:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8c000/0x59bee33f93fe996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe98f expref: 7 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.855035:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe59f8c200/0x59bee33f93fe9a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe99d expref: 6 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.855044:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe4583a200/0x59bee33f93fe9b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe9ab expref: 5 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.855055:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe4583be00/0x59bee33f93fe9c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93fe9b9 expref: 4 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.855077:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7c40fe00/0x59bee33f93febdb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93febd4 expref: 3 pid: 5821 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.855087:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe820e3c00/0x59bee33f93febe9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x59bee33f93febe2 expref: 2 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683454.855097:0:5818:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8dbe52ff9800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789683454.855108:0:5818:0:(genops.c:885:class_export_put()) final put ffff8dbe52ff9800/08ddc492-5684-492d-ac6b-b8fd660301db 00010000:00010000:0.0:1789683454.855120:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683454.855122:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683454.855124:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789683454.855130:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe52ff9800/08ddc492-5684-492d-ac6b-b8fd660301db for MGS 00000020:00000080:0.0:1789683454.855158:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe52ff8800 for MGS 00000100:00100000:2.0:1789683454.855507:0:5821:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8dbe49670e00:5821] 0 exiting: rc = 1 00000100:00100000:0.0:1789683454.861141:0:5823:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8dbe5bacb000:5823] 2 exiting: rc = 0 00000100:00100000:1.0:1789683454.861461:0:5822:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8dbe5022b600:5822] 1 exiting: rc = 0 00000100:00100000:2.0:1789683454.863476:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863489:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863498:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863505:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863513:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863521:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863527:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863534:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863540:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863545:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863555:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863560:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863565:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863570:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863575:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863583:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863591:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863599:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863606:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.863612:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864318:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864325:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864331:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864338:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864345:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864354:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864361:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864369:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864375:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864381:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864388:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864393:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864399:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864404:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864410:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864415:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864421:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864427:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864433:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864440:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864447:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864453:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864459:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864466:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864473:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864479:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864487:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864496:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864503:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864511:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864519:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864527:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864532:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864538:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864543:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864558:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864563:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864569:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864575:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864580:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864586:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864593:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864601:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683454.864611:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1789683454.867277:0:13017:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789683454.867284:0:13017:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1789683454.870581:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dbe7689e660 - data ffff8dbe4e6c8bd0/ffff8dbd45cbc400 00000020:01000000:1.0:1789683454.870748:0:13017:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dbe516b7cc0 - data ffff8dbe4f79dca8/ffff8dbe48a53000 00000020:00000080:0.0:1789683454.872620:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe678 00000020:00000080:0.0:1789683454.872629:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe58f4c000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789683454.872644:0:13017:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dbe46fc8800 from MGS, refs=2 00000020:01000004:0.0:1789683454.872647:0:13017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe46fc8800 2 00000020:01000004:0.0:1789683454.872650:0:13017:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dbe46fc8800 from MGS 00000020:00000080:0.0:1789683454.872696:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683454.872703:0:13017:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789683454.872706:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe58f48000/MGS 00000020:00000080:0.0:1789683454.872709:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe58f48000/MGS for MGS 00000020:01000000:0.0:1789683454.872717:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789683454.872774:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789683454.872779:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683454.872784:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789683454.872791:0:13017:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8dbe6feed000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789683454.872797:0:13017:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8dbe530619c0) has exports, disconnecting them 00000020:00080000:0.0:1789683454.872800:0:13017:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8dbe6feed000), last request at 1789683212 00000020:00000080:0.0:1789683454.872815:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe743 00000020:00080000:0.0:1789683454.872824:0:13017:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dbe6feed000): rc 0 00000020:00000080:0.0:1789683454.872829:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe6feed000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1789683454.873248:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe58f4c000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789683454.873257:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe6feed000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1789683454.884013:0:13017:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1789683454.884023:0:13017:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789683454.884027:0:13017:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789683454.884035:0:13017:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789683454.884230:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683454.884240:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1789683454.884247:0:13017:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe46fc8800 1 00000020:00000080:1.0:1789683454.884254:0:13017:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe66a 00000020:00000080:1.0:1789683454.884263:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe58f48800/lustre-MDT0000-osd_UUID 00000020:01000000:1.0:1789683454.884269:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1789683454.884277:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683454.884281:0:13017:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789683454.884285:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8dbe53064d40) has no exports 00000020:00000080:2.0:1789683454.884358:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe6fee8000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789683454.884367:0:38:0:(genops.c:885:class_export_put()) final put ffff8dbe6feeb000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789683454.884369:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe6feeb000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789683454.884376:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789683454.884437:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe58f48800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789683455.030992:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683455.031011:0:13017:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789683455.031016:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe46fcf000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789683455.031020:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe46fcf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789683455.031026:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789683455.031151:0:13017:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dbe46fc9000 00000020:01000000:1.0:1789683455.031172:0:13017:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1789683455.031176:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683455.031180:0:13017:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789683455.031185:0:13017:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8dbe53063380) has no exports 00000100:00100000:1.0:1789683455.031260:0:5831:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8dbe5baf9400:5831] 2 exiting: rc = 0 00000100:00100000:1.0:1789683455.031378:0:9827:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8dbe5ba1c600:9827] 4 exiting: rc = 0 00000100:00100000:3.0:1789683455.031504:0:6698:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8dbd45445a00:6698] 3 exiting: rc = 0 00000100:00100000:3.0:1789683455.031567:0:5830:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8dbe5baf8c00:5830] 1 exiting: rc = 0 00000100:00100000:2.0:1789683455.034268:0:5829:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8dbe5baf9e00:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1789683455.034808:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034821:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034828:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034833:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034838:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034843:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034850:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034869:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034873:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034879:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034884:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034890:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034899:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034908:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034918:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034929:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034940:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034952:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034960:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034969:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034979:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034989:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.034996:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035004:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035014:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035025:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035034:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035044:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035052:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035062:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035068:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035076:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035082:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035090:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035101:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035109:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035118:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035127:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035135:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035140:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035145:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035149:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035163:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035169:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035174:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035179:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035185:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035189:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035194:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035200:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035210:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035219:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035227:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035234:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035241:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035249:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035256:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035263:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035272:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035278:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035289:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035306:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035312:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.035320:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.046658:0:11963:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8dbe76a58800:11963] 2 exiting: rc = 0 00000100:00100000:2.0:1789683455.046857:0:5833:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8dbe48a6e400:5833] 1 exiting: rc = 0 00000100:00100000:0.0:1789683455.048414:0:5832:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8dbe48a6fa00:5832] 0 exiting: rc = 1 00000100:00100000:1.0:1789683455.048641:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048651:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048694:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048706:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048712:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048717:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048723:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048728:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048734:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048740:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048745:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048751:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048770:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048775:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048780:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048785:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048790:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048795:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048801:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048806:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048810:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048815:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048821:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048826:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048832:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048837:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048841:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048846:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048851:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048856:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048862:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048866:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048872:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048877:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048883:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048888:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048894:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048899:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048904:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048911:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048917:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048923:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048929:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.048940:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049022:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049030:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049035:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049060:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049066:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049071:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049075:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049080:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049085:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049089:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049094:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049098:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049103:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049107:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049112:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049116:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049122:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049127:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049132:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.049137:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683455.051985:0:5835:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8dbe5baf8400:5835] 1 exiting: rc = 0 00000100:00100000:3.0:1789683455.053400:0:5834:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8dbe48a6ee00:5834] 0 exiting: rc = 1 00000100:00100000:1.0:1789683455.054580:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054589:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054597:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054604:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054612:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054618:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054625:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054630:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054636:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054642:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054648:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054653:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054659:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054848:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054872:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054879:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054885:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054892:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054913:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054921:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054926:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054932:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054938:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054944:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054950:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054956:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054976:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054983:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054989:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.054995:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055001:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055007:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055012:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055018:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055024:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055030:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055035:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055041:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055305:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055314:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055321:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055326:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055332:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055337:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055342:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055348:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055354:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055359:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055366:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055372:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055392:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055399:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055612:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055625:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055631:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055636:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055642:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055647:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055653:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055658:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055691:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055698:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055703:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789683455.055709:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683455.070206:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8dbe52d4ce00:5836] 0 exiting: rc = 1 00000100:00100000:0.0:1789683455.070315:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8dbe52d4d600:5837] 1 exiting: rc = 0 00000100:00100000:0.0:1789683455.070368:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070376:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070381:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070386:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070391:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070396:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070401:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070407:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070411:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070416:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070421:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070426:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070431:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070436:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070441:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070446:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070450:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070455:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070460:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070464:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070469:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070474:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070480:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070485:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070490:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070494:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070500:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070505:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070510:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070529:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070534:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070539:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070544:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070548:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070553:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070559:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070563:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070568:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070573:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070577:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070582:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070587:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070596:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070601:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070605:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070611:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070616:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070620:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070626:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070630:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070635:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070640:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070646:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070651:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070656:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070777:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070784:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070789:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070794:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070799:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070804:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070809:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070814:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.070819:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.071291:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8dbe52d4d200:5838] 0 exiting: rc = 1 00000100:00100000:2.0:1789683455.072214:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8dbe52d49000:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1789683455.072332:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072340:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072347:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072352:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072358:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072363:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072368:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072373:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072378:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072383:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072389:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072394:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072399:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072404:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072409:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072413:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072418:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072423:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072427:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072432:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072438:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072443:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072449:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072454:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072459:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072464:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072468:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072473:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072478:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072483:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072488:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072493:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072499:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072505:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072525:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072530:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072535:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072539:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072543:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072548:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072553:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072557:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072562:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072567:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072572:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072577:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072582:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072587:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072592:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072597:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072602:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072607:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072612:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072618:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072623:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072627:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072631:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072636:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072640:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072645:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072649:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072654:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072659:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.072700:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.073035:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8dbe52d48a00:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1789683455.073896:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8dbe52d4d400:5840] 0 exiting: rc = 1 00000100:00100000:0.0:1789683455.074826:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074833:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074839:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074844:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074864:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074869:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074874:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074878:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074883:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074888:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074893:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074897:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074901:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074906:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074912:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074917:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074921:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074926:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074930:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074934:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074939:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074943:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074949:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074954:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074959:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074964:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074969:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074975:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074979:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074984:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074989:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074994:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.074998:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075003:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075009:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075013:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075018:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075023:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075029:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075041:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075064:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075069:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075075:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075080:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075085:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075090:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075096:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075101:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075106:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075111:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075116:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075121:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075126:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075131:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075136:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075141:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075145:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075150:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075154:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075159:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075164:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075169:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075175:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.075180:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789683455.076942:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8dbe52d48200:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1789683455.077135:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8dbe48bf3000:5844] 2 exiting: rc = 0 00000100:00100000:0.0:1789683455.077523:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8dbe52d42200:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1789683455.079289:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079298:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079305:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079310:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079316:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079322:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079328:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079333:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079339:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079358:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079363:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079369:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079374:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079379:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079385:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079390:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079395:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079401:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079416:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079422:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079427:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079432:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079437:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079442:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079447:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079452:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079458:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079462:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079468:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079472:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079477:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079483:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079488:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079494:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079499:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079505:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079509:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079514:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079519:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079525:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079529:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079535:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079553:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079561:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079572:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079578:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079583:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079588:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079594:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079598:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079604:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079609:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079615:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079620:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079625:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079630:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079635:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079640:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079645:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079651:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079656:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079691:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079698:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683455.079703:0:13017:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789683455.099361:0:13017:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683455.099375:0:13017:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789683455.099380:0:13017:0:(genops.c:885:class_export_put()) final put ffff8dbe48a25800/MDS_uuid 00000020:00000080:0.0:1789683455.099384:0:13017:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe48a25800/MDS_uuid for MDS 00000020:01000000:0.0:1789683455.099408:0:13017:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789683455.100280:0:13017:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1789683455.583885:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683456.611439:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683457.504241:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683457.504270:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815561984:0@lo:400:kworker.0 00000400:00000100:1.0:1789683457.504364:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618815561984 offset 0 length 224: 4 00000100:00100000:1.0:1789683457.504436:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815562240:0@lo:400:kworker.0 00000400:00000100:1.0:1789683457.504459:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618815562240 offset 0 length 224: 4 00000100:00100000:1.0:1789683457.504475:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683457.504479:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815562112:0@lo:400:kworker.0 00000400:00000100:1.0:1789683457.504494:0:3305:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618815562112 offset 0 length 224: 4 00010000:00010000:0.0:1789683457.632320:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789683458.119272:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789683458.119281:0:6700:0:(genops.c:885:class_export_put()) final put ffff8dbe7bc42000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789683458.119305:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7bc42000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789683458.119350:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe7bc44800 for lustre-OST0000 00000020:01000004:1.0:1789683458.376396:0:13167:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789683458.390798:0:13167:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789683458.390849:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683458.390864:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683458.390872:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683458.390896:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683458.390926:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789683458.390932:0:13167:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:3.0:1789683458.390955:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:1.0:1789683458.390957:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1789683458.390964:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683458.390972:0:13167:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dbe7c1afb80 x1876618815562112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683473 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1789683458.390977:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e2c00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683458.390984:0:5817:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683458.390996:0:13167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00010000:00010000:3.0:1789683458.391009:0:5817:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683458.391017:0:5817:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683458.391023:0:5817:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683458.391026:0:5817:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789683458.391028:0:5817:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00000100:00100000:1.0:1789683458.391032:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815562112:0@lo:400:kworker.0 00000100:00080000:1.0:1789683458.391066:0:13167:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1789683458.391069:0:5817:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683458.391077:0:5817:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683458.391103:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683458.391110:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2c00/0x59bee33f93fe9ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x59bee33f93fe9b2 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683458.391121:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683458.391123:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683458.391125:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683458.391132:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789683458.391144:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815562368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683458.391211:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789683458.391268:0:13167:0:(import.c:65:import_set_state_nolock()) ffff8dbd44f46800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789683458.391339:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876618815562496:0@lo:39:umount.0 00000400:00000100:3.0:1789683458.391361:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618815562496 offset 0 length 224: 4 00000100:00100000:1.0:1789683458.392665:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815562368 00000100:00100000:1.0:1789683458.392692:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815562368 00000100:00100000:1.0:1789683458.392751:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789683458.392760:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1876618815562368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789683458.392767:0:5814:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789683458 with bad export cookie 404178498572248724 00000100:00100000:1.0:1789683458.418446:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1876618815562368:12345-0@lo:103:ldlm_bl.0 Request processed in 25679us (27228us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789683458.418472:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1789683458.418528:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.160@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789683458.418547:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dbe52ffa800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1789683458.418551:0:3303:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.160@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1789683458.429079:0:3303:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.160@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1789683458.429085:0:3303:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1789683458.429094:0:3303:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dbe7c1aea00 x1876618815561984/t0(0) o400->MGC192.168.203.160@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789683473 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683458.429122:0:3303:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dbe7b91b800 x1876618815562368/t0(0) o103->MGC192.168.203.160@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789683474 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1789683458.429130:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1789683458.429133:0:3303:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1789683458.429134:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1789683458.429138:0:3303:0:(import.c:65:import_set_state_nolock()) ffff8dbe52ffa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683458.429142:0:3303:0:(import.c:545:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 145 00000100:00080000:3.0:1789683458.429156:0:3303:0:(import.c:666:import_select_connection()) MGC192.168.203.160@tcp: import ffff8dbe52ffa800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1789683458.429418:0:3303:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe799caa00 x1876618815562624/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789683458.429457:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:08ddc492-5684-492d-ac6b-b8fd660301db:3303:1876618815562368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683458.432537:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ddc492-5684-492d-ac6b-b8fd660301db:3301:1876618815562624:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:1.0:1789683458.432778:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:08ddc492-5684-492d-ac6b-b8fd660301db:3302:1876618815561984:0@lo:400:kworker.0 00000400:00000100:3.0:1789683458.432876:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618815562624 offset 0 length 520: 4 00000001:00100000:2.0:1789683458.623484:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789683458.623494:0:7641:0:(genops.c:885:class_export_put()) final put ffff8dbe4e9ee000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789683458.624019:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe4e9ee000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1789683458.624079:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe4e9eb000 for lustre-OST0001 00010000:00010000:1.0:1789683458.656212:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683459.681909:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683460.710023:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683461.727941:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683462.624111:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683462.624137:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789683462.624231:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683462.624252:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815562752:0@lo:400:kworker.0 00000400:00000100:1.0:1789683462.624312:0:3302:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618815562752 offset 0 length 224: 4 00010000:00010000:0.0:1789683462.751815:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683463.648200:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1789683463.648210:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789683463.648330:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815562880:0@lo:400:kworker.0 00000400:00000100:3.0:1789683463.648390:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618815562880 offset 0 length 224: 4 00010000:00010000:3.0:1789683463.778543:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683464.800448:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683465.823999:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683466.850942:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683467.872613:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683468.767840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683468.767852:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789683468.767852:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683458/real 1789683458] req@ffff8dbe799caa00 x1876618815562624/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789683468 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683468.767890:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dbe799caa00 x1876618815562624/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789683468 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683468.767901:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683458/real 1789683458] req@ffff8dbe76134e00 x1876618815562496/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683468 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683468.767913:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dbe76134e00 x1876618815562496/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683468 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683468.767934:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe52ffa800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789683468.767946:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00080000:3.0:1789683468.767950:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:2.0:1789683468.767950:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ddc492-5684-492d-ac6b-b8fd660301db:3301:1876618815562624:0@lo:250:ptlrpcd_00_01.0 00000100:00100000:0.0:1789683468.768019:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789683468.768038:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815563008:0@lo:400:kworker.0 00000400:00000100:0.0:1789683468.768103:0:3304:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618815563008 offset 0 length 224: 4 00000100:00080000:3.0:1789683468.768306:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789683468.768310:0:37:0:(import.c:65:import_set_state_nolock()) ffff8dbe52ffa800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683468.774974:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbd44f46800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789683468.775014:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876618815562496:0@lo:39:umount.0 00000100:00080000:0.0:1789683468.775127:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789683468.775134:0:13167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789683468.775140:0:13167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1789683468.775980:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 392 00000100:00080000:3.0:1789683468.775988:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.160@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789683468.776004:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.160@tcp: import ffff8dbe52ffa800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1789683468.776065:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe7b91b800 x1876618815563136/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00010000:0.0:1789683468.776129:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683468.776143:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683468.776150:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683468.776158:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683468.776186:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683468.776195:0:13167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683468.776202:0:13167:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683468.776208:0:13167:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683468.776213:0:13167:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683468.776224:0:13167:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789683468.776229:0:13167:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789683468.776273:0:13167:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789683468.776278:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789683468.776284:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683468.776290:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789683468.776295:0:13167:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8dbe7d6419c0) has no exports 00000020:00080000:0.0:1789683468.776325:0:13167:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8dbe7d6419c0) has no exports 00010000:00010000:3.0:1789683468.776353:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789683468.776361:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683468.776369:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe820e3000 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683468.776373:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683468.776384:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683468.776392:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683468.776398:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789683468.776400:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1789683468.776402:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1789683468.776418:0:5818:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dbe52ffa800 00010000:00010000:3.0:1789683468.776422:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683468.776429:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e3000/0x59bee33f93fe9b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93fe9c0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683468.776455:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683468.776458:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683468.776535:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44431e00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683468.776538:0:5818:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683468.776546:0:5818:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683468.776605:0:5818:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683468.776610:0:5818:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789683468.776612:0:5818:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789683468.776615:0:5818:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789683468.776621:0:5818:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dbe52ffa800 00010000:00010000:3.0:1789683468.776624:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683468.776631:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe44431e00/0x59bee33f93febe2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93febe9 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683468.776642:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683468.776644:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683468.776646:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683468.776758:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683468.778734:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ddc492-5684-492d-ac6b-b8fd660301db:3301:1876618815563136:0@lo:250:kworker.0 00000400:00000100:2.0:1789683468.778818:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876618815563136 offset 0 length 520: 4 00000020:01000000:0.0:1789683468.785810:0:13167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dbe52b7d060 - data ffff8dbe4e7c2438/ffff8dbd4474a800 00000020:01000000:0.0:1789683468.785979:0:13167:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dbe46ebbd20 - data ffff8dbe4e42ee58/ffff8dbd4478c400 00100000:10000000:0.0:1789683468.805032:0:13167:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789683468.854766:0:13167:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe7c8 00000020:00000080:2.0:1789683468.854779:0:13167:0:(genops.c:885:class_export_put()) final put ffff8dbd44c9e800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1789683468.854800:0:13167:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dbe52f3c000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1789683468.854805:0:13167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe52f3c000 2 00000020:01000004:2.0:1789683468.854808:0:13167:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dbe52f3c000 from lustre-OST0000 00000020:00000080:2.0:1789683468.854922:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683468.854936:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1789683468.854940:0:13167:0:(genops.c:885:class_export_put()) final put ffff8dbe497fd000/lustre-OST0000_UUID 00000020:00000080:2.0:1789683468.854943:0:13167:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe497fd000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1789683468.854951:0:13167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1789683468.855007:0:13167:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1789683468.855013:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1789683468.855018:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683468.855024:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789683468.855032:0:13167:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8dbd44f47000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789683468.855038:0:13167:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8dbe7d640000) has exports, disconnecting them 00000020:00080000:2.0:1789683468.855045:0:13167:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8dbd44f47000), last request at 1789683223 00000020:00000080:2.0:1789683468.855049:0:13167:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe7f2 00000020:00080000:2.0:1789683468.855062:0:13167:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dbd44f47000): rc 0 00000020:00000080:2.0:1789683468.855069:0:13167:0:(genops.c:885:class_export_put()) final put ffff8dbd44f47000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789683468.855098:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44c9e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789683468.855138:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44f47000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789683468.864255:0:13167:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789683468.864268:0:13167:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789683468.864274:0:13167:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789683468.864283:0:13167:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789683468.865029:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683468.865043:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789683468.865051:0:13167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe52f3c000 1 00000020:00000080:2.0:1789683468.865061:0:13167:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe782 00000020:00000080:2.0:1789683468.865071:0:13167:0:(genops.c:885:class_export_put()) final put ffff8dbe7c21e000/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789683468.865079:0:13167:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789683468.865085:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789683468.865091:0:13167:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789683468.865096:0:13167:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8dbe53060000) has no exports 00000020:00000080:2.0:1789683468.878019:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbd44f46800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789683468.878044:0:37:0:(genops.c:885:class_export_put()) final put ffff8dbd44c9e000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789683468.878070:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44c9e000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789683468.878090:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789683468.878171:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7c21e000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789683468.904599:0:13167:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789683468.904623:0:13167:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789683468.904631:0:13167:0:(genops.c:885:class_export_put()) final put ffff8dbe52f3f800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789683468.904638:0:13167:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe52f3f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789683468.904720:0:13167:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789683468.905205:0:13167:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dbe52f38000 00000020:02000400:2.0:1789683468.905260:0:13167:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1789683469.112793:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683470.112077:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683471.138847:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789683471.710308:0:13317:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789683471.725973:0:13317:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789683471.726071:0:13317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683471.726085:0:13317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683471.726092:0:13317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683471.726099:0:13317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683471.726117:0:13317:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789683471.726122:0:13317:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:1.0:1789683471.726145:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683471.726151:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683471.726158:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe4583b000 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:1.0:1789683471.726161:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683471.726169:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683471.726193:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683471.726603:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683471.726606:0:7626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789683471.726609:0:7626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789683471.726624:0:7626:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dbe52ffa800 00010000:00010000:1.0:1789683471.726628:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683471.726634:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe4583b000/0x59bee33f93fe98f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93fe996 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683471.726646:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683471.726648:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683471.726650:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683471.726667:0:13317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789683471.726997:0:13317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dbe7c1ac700 x1876618815562240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683473 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683471.727015:0:13317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dbe799c9880 x1876618815562752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683478 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683471.727038:0:13317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dbe799c8e00 x1876618815562880/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683479 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683471.727049:0:13317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dbe7b918a80 x1876618815563008/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683484 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683471.727057:0:13317:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789683471.727064:0:13317:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789683471.727089:0:13317:0:(import.c:65:import_set_state_nolock()) ffff8dbd45454800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1789683471.727175:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815562240:0@lo:400:kworker.0 00000100:00100000:0.0:1789683471.727368:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876618815562752:0@lo:400:kworker.0 00000100:00100000:2.0:1789683471.728088:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b918a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815563008:0@lo:400:kworker.0 00000100:00100000:2.0:1789683471.728100:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815562880:0@lo:400:kworker.0 00000100:00100000:2.0:1789683471.728132:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876618815563264:0@lo:39:umount.0 00000400:00000100:2.0:1789683471.728178:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876618815563264 offset 0 length 224: 4 00010000:00010000:3.0:1789683472.159975:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683473.183911:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683473.887890:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683473.887902:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1789683474.207910:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683475.234215:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683476.255906:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683477.285916:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683478.303924:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683479.007794:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789683479.007803:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 08ddc492-5684-492d-ac6b-b8fd660301db->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1789683479.328250:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683480.352104:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683481.378717:0:5818:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683481.951808:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683471/real 1789683471] req@ffff8dbe76137100 x1876618815563264/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683481.951841:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dbe76137100 x1876618815563264/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789683481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683481.951862:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbd45454800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789683481.951885:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76137100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876618815563264:0@lo:39:umount.0 00000100:00080000:1.0:1789683481.954700:0:13317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789683481.954710:0:13317:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789683481.954717:0:13317:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789683481.955798:0:13317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683481.955814:0:13317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683481.955821:0:13317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683481.955828:0:13317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683481.955859:0:13317:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683481.955866:0:13317:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683481.955873:0:13317:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683481.955880:0:13317:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683481.955886:0:13317:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683481.955965:0:13317:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789683481.955971:0:13317:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1789683481.955991:0:13317:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1789683481.955995:0:13317:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1789683481.956000:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683481.956005:0:13317:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789683481.956009:0:13317:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8dbe48c60000) has no exports 00000020:00080000:1.0:1789683481.956032:0:13317:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8dbe48c60000) has no exports 00000020:01000000:1.0:1789683481.957669:0:13317:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dbe52b7d6c0 - data ffff8dbe4e7f3a20/ffff8dbd44749800 00000020:01000000:1.0:1789683481.959656:0:13317:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8dbe7c11ce40 - data ffff8dbe4e722000/ffff8dbd469fe800 00010000:00010000:2.0:1789683481.959773:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683481.959783:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683481.959878:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8e00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683481.959896:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683481.959907:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683481.959915:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683481.959921:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789683481.959924:0:7626:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1789683481.959927:0:7626:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1789683481.959942:0:7626:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dbe52ffa800 00010000:00010000:2.0:1789683481.959946:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683481.959953:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8e00/0x59bee33f93fe99d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93fe9a4 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683481.959964:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683481.959968:0:7626:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683481.959974:0:7626:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe44430200 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683481.959976:0:7626:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683481.959983:0:7626:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683481.959989:0:7626:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683481.960003:0:7626:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789683481.960005:0:7626:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789683481.960007:0:7626:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789683481.960013:0:7626:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dbe52ffa800 00010000:00010000:2.0:1789683481.960017:0:7626:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683481.960023:0:7626:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe44430200/0x59bee33f93febd4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93febdb expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683481.960036:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683481.960038:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683481.960040:0:7626:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683481.961827:0:5817:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1789683481.971538:0:13317:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789683482.011595:0:13317:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe893 00000020:00000080:1.0:1789683482.011605:0:13317:0:(genops.c:885:class_export_put()) final put ffff8dbd45457000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1789683482.011626:0:13317:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dbe53b2b800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1789683482.011629:0:13317:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe53b2b800 2 00000020:01000004:1.0:1789683482.011632:0:13317:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8dbe53b2b800 from lustre-OST0001 00000020:00000080:1.0:1789683482.011656:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683482.011665:0:13317:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1789683482.011668:0:13317:0:(genops.c:885:class_export_put()) final put ffff8dbd44583800/lustre-OST0001_UUID 00000020:00000080:1.0:1789683482.011691:0:13317:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44583800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1789683482.011699:0:13317:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1789683482.011817:0:13317:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 08ddc492-5684-492d-ac6b-b8fd660301db->MGS 00010000:00010000:1.0:1789683482.011833:0:13317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe7ac expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683482.011845:0:13317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe7ac expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683482.011851:0:13317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1789683482.011863:0:13317:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1789683482.011866:0:13317:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1789683482.011881:0:13317:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dbe52ffa800 00010000:00010000:1.0:1789683482.011886:0:13317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe820e2000/0x59bee33f93fe7a5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93fe7ac expref: -99 pid: 6672 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683482.011903:0:13317:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x59bee33f93fe9ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789683482.011910:0:13317:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x59bee33f93fe9ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683482.011915:0:13317:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789683482.011917:0:13317:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1789683482.011919:0:13317:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1789683482.011928:0:13317:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8dbe52ffa800 00010000:00010000:1.0:1789683482.011931:0:13317:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe59f8d400/0x59bee33f93fe9e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x59bee33f93fe9ea expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789683482.011946:0:13317:0:(import.c:65:import_set_state_nolock()) ffff8dbe52ffa800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1789683482.011950:0:13317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789683482.011952:0:13317:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789683482.011954:0:13317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789683482.011958:0:13317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789683482.011969:0:13317:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8dbe7b91b800 x1876618815563136/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789683483 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789683482.011993:0:13317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789683482.011997:0:13317:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1789683482.012118:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:08ddc492-5684-492d-ac6b-b8fd660301db:3301:1876618815563136:0@lo:250:kworker.0 10000000:01000000:1.0:1789683482.012184:0:13317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789683482.012191:0:13317:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe686 00000020:00000080:1.0:1789683482.012196:0:13317:0:(genops.c:885:class_export_put()) final put ffff8dbe48a21800/08ddc492-5684-492d-ac6b-b8fd660301db 00000020:01000000:1.0:1789683482.012202:0:13317:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.160@tcp (flags='') 00000020:00000080:1.0:1789683482.012294:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683482.012300:0:13317:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.160@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789683482.012303:0:13317:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8dbe48a44d40) has no exports 00000020:00000080:3.0:1789683482.012552:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd45457000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789683482.012563:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe48a21800/08ddc492-5684-492d-ac6b-b8fd660301db for MGC192.168.203.160@tcp 10000000:01000000:0.0:1789683482.013663:0:5825:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1789683482.013856:0:13317:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.160@tcp: client import never connected 00000100:00080000:1.0:1789683482.013861:0:13317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1789683482.013864:0:13317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1789683482.013868:0:13317:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1789683482.013870:0:13317:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1789683482.013934:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789683482.013942:0:13317:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.160@tcp (uuid 08ddc492-5684-492d-ac6b-b8fd660301db) 00000020:01000000:1.0:1789683482.013950:0:13317:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1789683482.013954:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789683482.013958:0:13317:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789683482.013965:0:13317:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8dbd45452000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789683482.013971:0:13317:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8dbe48c64d40) has exports, disconnecting them 00000020:00080000:1.0:1789683482.013976:0:13317:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8dbd45452000), last request at 1789683236 00000020:00000080:1.0:1789683482.013980:0:13317:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe8bd 00000020:00080000:1.0:1789683482.013992:0:13317:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8dbd45452000): rc 0 00000020:00000080:1.0:1789683482.013996:0:13317:0:(genops.c:885:class_export_put()) final put ffff8dbd45452000/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1789683482.014516:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbe52ffa800 for MGC192.168.203.160@tcp 00000020:00000080:3.0:1789683482.014525:0:37:0:(genops.c:885:class_export_put()) final put ffff8dbe52ff9000/08ddc492-5684-492d-ac6b-b8fd660301db 00000020:00000080:3.0:1789683482.014528:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe52ff9000/08ddc492-5684-492d-ac6b-b8fd660301db for MGC192.168.203.160@tcp 00000020:01000000:3.0:1789683482.014533:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.160@tcp (08ddc492-5684-492d-ac6b-b8fd660301db) 00000020:00000080:3.0:1789683482.014782:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd45452000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789683482.015957:0:13317:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789683482.015964:0:13317:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789683482.015968:0:13317:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789683482.015974:0:13317:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789683482.016064:0:5818:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1789683482.016151:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8dbd45454800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:3.0:1789683482.016292:0:7626:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1789683482.016408:0:5817:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1789683482.016621:0:7628:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8dbe76f3de00:7628] 2 exiting: rc = 0 00000100:00100000:3.0:1789683482.017835:0:5813:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8dbe4e92c600:5813] 1 exiting: rc = 0 00000100:00100000:0.0:1789683482.019383:0:5812:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8dbe5ba43a00:5812] 0 exiting: rc = 1 00000100:00100000:3.0:1789683482.020364:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.020645:0:5815:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8dbe5baf8200:5815] 1 exiting: rc = 0 00000100:00100000:3.0:1789683482.020737:0:7627:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8dbd46def600:7627] 3 exiting: rc = 0 00000100:00100000:0.0:1789683482.020903:0:11663:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff8dbe53f6a800:11663] 4 exiting: rc = 0 00000100:00100000:0.0:1789683482.020962:0:5816:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8dbe5baf9800:5816] 2 exiting: rc = 0 00000100:00100000:1.0:1789683482.021377:0:5814:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8dbe5baf9000:5814] 0 exiting: rc = 1 00000100:00100000:3.0:1789683482.023270:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023281:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023286:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023297:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023304:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023312:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023318:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023324:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023331:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023337:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023342:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023349:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023355:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023360:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023368:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023374:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023383:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023388:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023393:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023398:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023403:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023409:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023423:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023430:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023435:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023440:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023444:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023449:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023455:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023469:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023493:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023498:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023504:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023509:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023514:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023519:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023523:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023528:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023534:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023540:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023544:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023549:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023554:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023559:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023563:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023568:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023572:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023577:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023582:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023587:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023592:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023597:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023603:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023608:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023613:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023618:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023622:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023627:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023632:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023639:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023643:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023648:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023653:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.023658:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789683482.025193:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789683482.025223:0:13317:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789683482.025229:0:13317:0:(genops.c:885:class_export_put()) final put ffff8dbd45450000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789683482.025234:0:13317:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd45450000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789683482.025246:0:13317:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789683482.025286:0:13317:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe53b2b800 1 00000020:00000080:3.0:1789683482.025294:0:13317:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x59bee33f93fe862 00000020:00000080:3.0:1789683482.025300:0:13317:0:(genops.c:885:class_export_put()) final put ffff8dbd44582000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789683482.025321:0:13317:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789683482.025326:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789683482.025330:0:13317:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789683482.025334:0:13317:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8dbe4848b380) has no exports 00000020:00000080:0.0:1789683482.025432:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbd44582000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1789683482.039532:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683482.039546:0:13317:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789683482.039552:0:13317:0:(genops.c:885:class_export_put()) final put ffff8dbe53b2e000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789683482.039556:0:13317:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe53b2e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789683482.039562:0:13317:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789683482.039801:0:13317:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8dbe53b28800 00000020:01000000:0.0:1789683482.039833:0:13317:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789683482.039837:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789683482.039842:0:13317:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789683482.039846:0:13317:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8dbe48488000) has no exports 00000020:00000080:0.0:1789683482.039866:0:13317:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789683482.039872:0:13317:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789683482.039874:0:13317:0:(genops.c:885:class_export_put()) final put ffff8dbe7c21b000/OSS_uuid 00000020:00000080:0.0:1789683482.039876:0:13317:0:(genops.c:844:class_export_destroy()) destroying export ffff8dbe7c21b000/OSS_uuid for OSS 00000020:01000000:0.0:1789683482.039883:0:13317:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1789683482.039905:0:5824:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1789683482.040041:0:6674:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8dbe7b96fe00:6674] 0 exiting: rc = 1 00000100:00100000:0.0:1789683482.040087:0:6677:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8dbe7b96f400:6677] 2 exiting: rc = 0 00000100:00100000:0.0:1789683482.040130:0:8465:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8dbe7d6b6e00:8465] 3 exiting: rc = 0 00000100:00100000:0.0:1789683482.040176:0:6676:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8dbe7b96fc00:6676] 1 exiting: rc = 0 00000100:00100000:0.0:1789683482.042578:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042591:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042598:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042605:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042610:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042615:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042620:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042625:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042630:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042636:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042641:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042647:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042653:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042658:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042663:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042669:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042699:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042704:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042709:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042715:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042736:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042742:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042747:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042752:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042757:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042762:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042768:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042773:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042777:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042782:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042788:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042793:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042798:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042805:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042810:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042815:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042820:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042825:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042830:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042835:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042840:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042845:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042851:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042857:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042862:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042867:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042872:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042877:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042883:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042888:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042893:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042898:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042903:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042908:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042913:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042925:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042930:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042935:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042940:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042946:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042951:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042955:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042961:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.042971:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.044125:0:6678:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8dbe762ea400:6678] 0 exiting: rc = 1 00000100:00100000:2.0:1789683482.045411:0:6679:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8dbe70c4a600:6679] 1 exiting: rc = 0 00000100:00100000:0.0:1789683482.045935:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045944:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045949:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045954:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045958:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045963:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045967:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045972:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045977:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045982:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045987:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045992:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.045997:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046001:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046006:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046011:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046046:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046052:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046057:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046063:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046068:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046072:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046077:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046082:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046086:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046091:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046108:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046114:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046119:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046124:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046128:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046133:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046139:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046144:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046149:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046153:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046157:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046162:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046166:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046171:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046175:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046180:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046185:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046189:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046195:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046199:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046203:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046218:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046226:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046232:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046236:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046242:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046249:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046253:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046258:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046265:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046271:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046275:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046280:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046285:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046289:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046301:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046306:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.046311:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.047664:0:6680:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8dbe762eba00:6680] 0 exiting: rc = 1 00000100:00100000:1.0:1789683482.047928:0:6682:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8dbe4e92cc00:6682] 2 exiting: rc = 0 00000100:00100000:2.0:1789683482.048490:0:6681:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8dbe762eb600:6681] 1 exiting: rc = 0 00000100:00100000:0.0:1789683482.049041:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049050:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049055:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049061:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049067:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049081:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049088:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049094:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049099:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049105:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049111:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049116:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049122:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049128:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049140:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049149:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049154:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049159:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049165:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049171:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049177:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049182:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049189:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049195:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049201:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049206:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049223:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049229:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049234:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049239:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049244:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049249:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049265:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049270:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049276:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049281:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049286:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049291:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049312:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049319:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049325:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049331:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049337:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049343:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049350:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049355:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049360:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049366:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049371:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049376:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049382:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049388:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049393:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049399:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049405:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049411:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049429:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049435:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049441:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049471:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049480:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049486:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049493:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.049499:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060515:0:6683:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8dbe532aa800:6683] 0 exiting: rc = 1 00000100:00100000:0.0:1789683482.060603:0:6684:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8dbe76221c00:6684] 1 exiting: rc = 0 00000100:00100000:0.0:1789683482.060654:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060701:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060707:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060713:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060784:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060792:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060798:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060803:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060808:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060813:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060817:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060823:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060828:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060833:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060840:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060845:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060850:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060855:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060860:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060866:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060872:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060877:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060883:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060889:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060894:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060899:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060904:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060910:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060915:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060920:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060926:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060931:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060936:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060942:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060947:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060952:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060966:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060971:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060977:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060982:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060986:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060990:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.060995:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061000:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061005:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061010:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061016:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061021:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061026:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061032:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061037:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061042:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061047:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061053:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061058:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061063:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061068:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061072:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061077:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061083:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061088:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061093:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061098:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.061103:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789683482.062806:0:6686:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8dbe76780e00:6686] 1 exiting: rc = 0 00000100:00100000:2.0:1789683482.062966:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8dbe5bae1c00:6685] 0 exiting: rc = 1 00000100:00100000:3.0:1789683482.063114:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063123:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063129:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063135:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063140:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063146:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063151:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063167:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063173:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063179:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063185:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063191:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063196:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063201:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063206:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063309:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063315:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063321:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063327:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063346:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063362:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063367:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063375:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063381:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063387:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063392:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063398:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063404:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063411:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063496:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063505:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063525:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063532:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063538:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063544:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063550:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063555:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063561:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063566:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063574:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063579:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063585:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063591:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063609:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063615:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063620:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063626:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063632:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063638:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063643:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063649:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063656:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063661:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063667:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063703:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063831:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063839:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063844:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063853:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063858:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063864:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063870:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063876:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789683482.063881:0:13317:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789683482.089745:0:13317:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789683500.260544:0:13929:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789683509.730799:0:14391:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789683509.730804:0:14391:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789683509.730913:0:14391:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dbe529e1800 00000020:01000004:2.0:1789683509.730929:0:14391:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1789683509.730936:0:14391:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789683509.730949:0:14391:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8dbe48c63380) 00000020:00000080:2.0:1789683509.730963:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789683509.745658:0:14391:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789683509.747999:0:14391:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1789683509.748427:0:14391:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789683509.748497:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 455: rc = 0 00100000:10000000:3.0:1789683509.748595:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 455: rc = 0 00100000:10000000:3.0:1789683509.752145:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 455: rc = 0 00100000:10000000:3.0:1789683509.752350:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 455: rc = 0 00100000:10000000:3.0:1789683509.752451:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 455: rc = 0 00100000:10000000:3.0:1789683509.752552:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 455: rc = 0 00100000:10000000:3.0:1789683509.752935:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 457: rc = 0 00100000:10000000:3.0:1789683509.755137:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 770: rc = 0 00100000:10000000:3.0:1789683509.755513:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 770: rc = 0 00100000:10000000:3.0:1789683509.756827:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 775: rc = 0 00100000:10000000:3.0:1789683509.758477:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 775: rc = 0 00100000:10000000:3.0:1789683509.759658:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 775: rc = 0 00100000:10000000:3.0:1789683509.759935:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 775: rc = 0 00100000:10000000:3.0:1789683509.760620:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 775: rc = 0 00100000:10000000:3.0:1789683509.760929:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 775: rc = 0 00100000:10000000:3.0:1789683509.762703:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 775: rc = 0 00100000:10000000:3.0:1789683509.762978:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 775: rc = 0 00100000:10000000:3.0:1789683509.763921:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 775: rc = 0 00100000:10000000:3.0:1789683509.764283:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 775: rc = 0 00100000:10000000:3.0:1789683509.764543:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 775: rc = 0 00100000:10000000:3.0:1789683509.764821:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 775: rc = 0 00100000:10000000:3.0:1789683509.765236:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 794: rc = 0 00100000:10000000:3.0:1789683509.765476:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 794: rc = 0 00100000:10000000:3.0:1789683509.765735:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 794: rc = 0 00100000:10000000:2.0:1789683509.771978:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 794: rc = 0 00100000:10000000:2.0:1789683509.772379:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 794: rc = 0 00100000:10000000:2.0:1789683509.773051:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 794: rc = 0 00100000:10000000:2.0:1789683509.773622:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 794: rc = 0 00100000:10000000:2.0:1789683509.774568:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 794: rc = 0 00100000:10000000:2.0:1789683509.775475:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 794: rc = 0 00100000:10000000:2.0:1789683509.776310:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 794: rc = 0 00100000:10000000:2.0:1789683509.776573:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 794: rc = 0 00100000:10000000:2.0:1789683509.779428:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 794: rc = 0 00100000:10000000:2.0:1789683509.779731:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 794: rc = 0 00100000:10000000:2.0:1789683509.779974:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 794: rc = 0 00100000:10000000:2.0:1789683509.780495:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 794: rc = 0 00100000:10000000:2.0:1789683509.784614:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 794: rc = 0 00100000:10000000:2.0:1789683509.784928:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 794: rc = 0 00100000:10000000:2.0:1789683509.785864:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 794: rc = 0 00100000:10000000:2.0:1789683509.787045:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 794: rc = 0 00100000:10000000:2.0:1789683509.787776:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 794: rc = 0 00100000:10000000:2.0:1789683509.788457:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 794: rc = 0 00100000:10000000:2.0:1789683509.788749:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 794: rc = 0 00100000:10000000:2.0:1789683509.789334:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 794: rc = 0 00100000:10000000:2.0:1789683509.789582:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 794: rc = 0 00100000:10000000:2.0:1789683509.791389:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 794: rc = 0 00100000:10000000:2.0:1789683509.791727:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 794: rc = 0 00100000:10000000:2.0:1789683509.792471:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 794: rc = 0 00100000:10000000:2.0:1789683509.792974:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 794: rc = 0 00100000:10000000:2.0:1789683509.796388:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 794: rc = 0 00100000:10000000:2.0:1789683509.800810:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 794: rc = 0 00100000:10000000:2.0:1789683509.801182:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 794: rc = 0 00100000:10000000:2.0:1789683509.801460:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 794: rc = 0 00100000:10000000:2.0:1789683509.801867:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 783: rc = 0 00100000:10000000:2.0:1789683509.802399:0:14391:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789683509.802555:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 645: rc = 0 00100000:10000000:2.0:1789683509.802769:0:14391:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789683509.802834:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 645: rc = 0 00100000:10000000:2.0:1789683509.803029:0:14391:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789683509.803093:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 645: rc = 0 00100000:10000000:3.0:1789683509.810507:0:14391:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1789683509.810592:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 771: rc = 0 00100000:10000000:3.0:1789683509.810837:0:14391:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1789683509.810903:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 771: rc = 0 00100000:10000000:3.0:1789683509.811081:0:14391:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1789683509.811145:0:14391:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 771: rc = 0 00000020:00000080:3.0:1789683509.811430:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1789683509.811437:0:14391:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683509.811448:0:14391:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93ff979 00000020:01000004:3.0:1789683509.811455:0:14391:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1789683509.811460:0:14391:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1789683509.811465:0:14391:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dbe529e1800 from MGS 00000020:01000004:3.0:1789683509.811468:0:14391:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1789683509.811477:0:14391:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8dbe48488000) 00000020:00000080:3.0:1789683509.811486:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1789683509.811533:0:14391:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe529e1800 from MGS, refs=2 00080000:01000000:3.0:1789683509.811538:0:14391:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789683509.811542:0:14391:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93ff987 00000100:00100000:3.0:1789683509.811632:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1789683509.811808:0:14391:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1789683509.811814:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789683509.818358:0:14391:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789683509.818379:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789683509.819489:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683509.819704:0:14391:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789683509.819711:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789683509.820523:0:14391:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789683509.820530:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789683509.820877:0:14391:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789683509.820884:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789683509.822583:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683509.822587:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683509.822589:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683509.822937:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683509.822946:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683509.822948:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683509.823573:0:14391:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789683509.835558:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789683509.845969:0:14391:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789683509.845990:0:14391:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789683509.845994:0:14391:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1789683509.853508:0:14400:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789683509.860901:0:14391:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789683509.861025:0:14391:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789683509.864066:0:14391:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789683509.864542:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683509.865941:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789683509.865949:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1789683509.867937:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1789683509.867952:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1789683509.869007:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1789683509.869026:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789683509.869911:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789683509.869933:0:14391:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.160@tcp' 00000020:01000004:2.0:1789683509.869935:0:14391:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789683509.869966:0:14391:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.160@tcp (typ=mgc) 00000020:00000080:2.0:1789683509.869978:0:14391:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.160@tcp (ffff8dbe48c64d40) 00000020:00000080:2.0:1789683509.869992:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789683509.870407:0:14391:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbe497f8800@MGC192.168.203.160@tcp: add connection 192.168.203.160@tcp at head 00010000:00010000:2.0:1789683509.870557:0:14391:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.160@tcp-0 is initialized 00000040:01000000:2.0:1789683509.870563:0:14391:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 1 is initialized 00000100:00080000:0.0:1789683509.870865:0:14405:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789683509.886200:0:14406:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789683509.890815:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.160@tcp (uuid 267f495e-c971-4db4-b237-3907c961127d) 00000020:00000080:3.0:1789683509.890853:0:14391:0:(genops.c:1384:class_connect()) connect: client 267f495e-c971-4db4-b237-3907c961127d, cookie 0x59bee33f93ff995 00000100:00080000:3.0:1789683509.890867:0:14391:0:(import.c:545:import_select_connection()) MGC192.168.203.160@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683509.890881:0:14391:0:(import.c:666:import_select_connection()) MGC192.168.203.160@tcp: import ffff8dbe497f8800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1789683509.890919:0:14391:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe7b919880 x1876618815563392/t0(0) o250->MGC192.168.203.160@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683509.890938:0:14391:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 267f495e-c971-4db4-b237-3907c961127d->MGS 00000020:01000004:3.0:1789683509.890959:0:14391:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789683509.890965:0:14391:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789683509.890979:0:14391:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8dbe4848b380) 00000020:00000080:3.0:1789683509.890991:0:14391:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789683509.894516:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:267f495e-c971-4db4-b237-3907c961127d:3301:1876618815563392:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789683509.894602:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683509.898034:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815563392 00000100:00100000:1.0:1789683509.898049:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815563392 00000100:00100000:1.0:1789683509.898093:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683509.898101:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5314d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1876618815563392:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1789683509.898127:0:14402:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 267f495e-c971-4db4-b237-3907c961127d@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1789683509.898166:0:14402:0:(genops.c:1384:class_connect()) connect: client 267f495e-c971-4db4-b237-3907c961127d, cookie 0x59bee33f93ff9a3 00000100:00080000:1.0:1789683509.898307:0:14402:0:(import.c:65:import_set_state_nolock()) ffff8dbd46f58000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683509.898415:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5314d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+5:3301:x1876618815563392:12345-0@lo:250:mount.lustre.0 Request processed in 313us (3812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683509.898423:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683509.898982:0:3301:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.160@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789683509.898994:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.160@tcp: connect to target with instance 0 00000100:00080000:0.0:1789683509.899001:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.160@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789683509.899006:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789683509.899009:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe497f8800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789683509.899012:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789683509.899021:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789683509.899027:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b919880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:267f495e-c971-4db4-b237-3907c961127d:3301:1876618815563392:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789683509.907535:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683509.907764:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789683509.907771:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789683509.918389:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683509.918403:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789683509.919088:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789683509.919096:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789683509.920014:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683509.920182:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789683509.920186:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789683509.926297:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789683509.926310:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789683510.005956:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683510.006156:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789683510.006162:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1789683510.009902:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1789683510.009915:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789683510.023235:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683510.025577:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789683510.025590:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1789683510.026024:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789683510.026030:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789683510.030617:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683510.030852:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789683510.030859:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1789683510.034287:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789683510.034301:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789683510.034925:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789683510.035292:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789683510.035298:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1789683510.040557:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1789683510.040572:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789683510.061938:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683510.062238:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789683510.062245:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789683510.063546:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683510.063559:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789683510.064469:0:14391:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789683510.064477:0:14391:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1789683510.067915:0:14391:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1789683510.067941:0:14391:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1789683510.067946:0:14391:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1789683510.068085:0:14391:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789683510.068121:0:14391:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1789683510.068126:0:14391:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789683510.068127:0:14391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789683510.068129:0:14391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683510.068130:0:14391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683510.068131:0:14391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683510.068132:0:14391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683510.068134:0:14391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683510.068135:0:14391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789683510.068137:0:14391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683510.068138:0:14391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789683510.068141:0:14391:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1789683510.068143:0:14391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683510.068145:0:14391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789683510.068146:0:14391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683510.068147:0:14391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683510.068159:0:14391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683510.068160:0:14391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683510.068161:0:14391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683510.068162:0:14391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789683510.068164:0:14391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683510.068165:0:14391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789683510.068190:0:14391:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789683510.068209:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815563520:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789683510.068294:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683510.068653:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b480 going to sleep for 11 seconds 00000100:00100000:0.0:1789683510.071560:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815563520 00000100:00100000:0.0:1789683510.071576:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815563520 00000100:00100000:0.0:1789683510.071631:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683510.071641:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5314dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+5:14391:x1876618815563520:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789683510.071725:0:14404:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789683510.071734:0:14404:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789683510.071737:0:14404:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789683510.072270:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789683510.072643:0:14404:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789683510.073628:0:14426:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789683510.073634:0:14426:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789683510.073637:0:14426:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789683510.073739:0:14426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1789683510.073989:0:14404:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789683510.074000:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1789683510.082361:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5314dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+5:14391:x1876618815563520:12345-0@lo:253:mount.lustre.0 Request processed in 10712us (14058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683510.082379:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683510.082576:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815563520:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683510.082592:0:14391:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789683510.082596:0:14391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683510.082597:0:14391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789683510.082599:0:14391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683510.082600:0:14391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683510.082601:0:14391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683510.082602:0:14391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683510.082603:0:14391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789683510.082605:0:14391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789683510.082607:0:14391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683510.082608:0:14391:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789683510.082628:0:14391:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dbe529e1800 from lustre-MDT0000 10000000:01000000:0.0:1789683510.082663:0:14391:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789683510.082667:0:14391:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789683510.082726:0:14391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8dbe48c64d40 10000000:01000000:0.0:1789683510.082733:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789683510.082742:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8dbe48c64d40 from 1 10000000:01000000:0.0:1789683510.082746:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789683510.082785:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.082795:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.082804:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.082823:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815563648:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683510.082872:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.082901:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683510.082977:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815563648 00000100:00100000:2.0:1789683510.082984:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815563648 00000100:00100000:2.0:1789683510.083016:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789683510.083024:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5314c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+5:14391:x1876618815563648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683510.083036:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683510.083051:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7b908200/0x59bee33f93ff9b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ff9aa expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.083072:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7b908200/0x59bee33f93ff9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ff9aa expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.083083:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7b908200/0x59bee33f93ff9b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ff9aa expref: 6 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.083092:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908200, rc 0) 00000100:00100000:2.0:1789683510.083120:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5314c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+6:14391:x1876618815563648:12345-0@lo:101:mount.lustre.0 Request processed in 97us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683510.083126:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683510.083354:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815563648:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683510.083368:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.083377:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.083419:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815563776:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683510.083443:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.083477:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683510.083627:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815563776 00000100:00100000:2.0:1789683510.083638:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815563776 00000100:00100000:2.0:1789683510.083670:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683510.083704:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+6:14391:x1876618815563776:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683510.083929:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+6:14391:x1876618815563776:12345-0@lo:501:mount.lustre.0 Request processed in 224us (483us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789683510.083939:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683510.084066:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815563776:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789683510.084087:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789683510.084105:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.084114:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683510.084121:0:14391:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dbe529e1800 10000000:01000000:0.0:1789683510.084125:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789683510.084128:0:14391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8dbe529e1800 10000000:01000000:0.0:1789683510.084130:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789683510.084133:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8dbe529e1800 from 1 10000000:01000000:0.0:1789683510.084135:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789683510.084165:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e600/0x59bee33f93ff9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.084183:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e600/0x59bee33f93ff9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.084192:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e600/0x59bee33f93ff9b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.084205:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815563904:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683510.084425:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.084453:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683510.084500:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815563904 00000100:00100000:1.0:1789683510.084506:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815563904 00000100:00100000:1.0:1789683510.084538:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789683510.084545:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+6:14391:x1876618815563904:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683510.084555:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683510.084569:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe76fc7400/0x59bee33f93ff9bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ff9b8 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683510.084584:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe76fc7400/0x59bee33f93ff9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ff9b8 expref: 7 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683510.084593:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe76fc7400/0x59bee33f93ff9bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ff9b8 expref: 7 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683510.084600:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7400, rc 0) 00000100:00100000:1.0:1789683510.084637:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+7:14391:x1876618815563904:12345-0@lo:101:mount.lustre.0 Request processed in 92us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683510.084642:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683510.086240:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815563904:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683510.086278:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e600/0x59bee33f93ff9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9bf expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.086290:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e600/0x59bee33f93ff9b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ff9bf expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683510.086306:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789683510.086326:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e600/0x59bee33f93ff9b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9bf expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.086335:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e600/0x59bee33f93ff9b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9bf expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683510.086342:0:14391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789683510.086349:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789683510.086355:0:14391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8dbe529e1800 10000000:01000000:0.0:1789683510.086358:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789683510.086376:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789683510.086378:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789683510.086411:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93ff9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.086420:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93ff9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.086428:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93ff9c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.086447:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815564032:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683510.086497:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.086577:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683510.088174:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815564032 00000100:00100000:3.0:1789683510.088186:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815564032 00000100:00100000:3.0:1789683510.088262:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683510.088273:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+7:14391:x1876618815564032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683510.088288:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683510.088306:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93ff9cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ff9c6 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683510.088329:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93ff9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ff9c6 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683510.088354:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9c00/0x59bee33f93ff9cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ff9c6 expref: 8 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683510.088362:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9c00, rc 0) 00000100:00100000:3.0:1789683510.088426:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+8:14391:x1876618815564032:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683510.088432:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683510.088726:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815564032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683510.088743:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93ff9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9cd expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.088753:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93ff9c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ff9cd expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.088813:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815564160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683510.088844:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.088876:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683510.089366:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815564160 00000100:00100000:2.0:1789683510.089372:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815564160 00000100:00100000:2.0:1789683510.089409:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789683510.089416:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+8:14391:x1876618815564160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683510.089829:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+9:14391:x1876618815564160:12345-0@lo:501:mount.lustre.0 Request processed in 412us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683510.089836:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683510.090479:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815564160:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683510.090524:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815564288:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683510.090575:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.090614:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683510.090823:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815564288 00000100:00100000:2.0:1789683510.090830:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815564288 00000100:00100000:2.0:1789683510.090904:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683510.090912:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+9:14391:x1876618815564288:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683510.091373:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+9:14391:x1876618815564288:12345-0@lo:503:mount.lustre.0 Request processed in 461us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683510.091381:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789683510.091460:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815564288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683510.094502:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b918e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14427:1876618815564416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683510.094588:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683510.094634:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5305d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683510.095825:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815564416 00000100:00100000:1.0:1789683510.095849:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815564416 00000100:00100000:1.0:1789683510.095903:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683510.095913:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+9:14427:x1876618815564416:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683510.096712:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+9:14427:x1876618815564416:12345-0@lo:502:llog_process_th.0 Request processed in 797us (2120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683510.096722:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789683510.096835:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b918e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14427:1876618815564416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789683510.096876:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683510.096887:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683510.096890:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789683510.096896:0:14427:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789683510.096899:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683510.096913:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8dbe4848cd40) 00000020:00000080:3.0:1789683510.096931:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789683510.096936:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789683510.097001:0:14427:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789683510.097008:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93ff9db 00000020:00000080:3.0:1789683510.097229:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789683510.097235:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789683510.097238:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683510.097240:0:14427:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789683510.097243:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789683510.097247:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683510.097257:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789683510.097267:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683510.097275:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8dbe484899c0) 00000020:00000080:3.0:1789683510.097284:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789683510.097288:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789683510.097290:0:14427:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789683510.097293:0:14427:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789683510.097299:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789683510.097341:0:14427:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe529e1800 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789683510.097363:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8dbe6fe419c0) 00000020:00000080:3.0:1789683510.097376:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789683510.097434:0:14427:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789683510.097440:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93ff9f0 00000020:00000080:3.0:1789683510.097525:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789683510.097532:0:14427:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789683510.097536:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x59bee33f93ff9f7 00080000:01000000:3.0:1789683510.097541:0:14427:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789683510.097544:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93ff9fe 00010000:00010000:3.0:1789683510.205966:0:14427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1789683510.206585:0:14427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1789683510.206942:0:14427:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789683510.207945:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8dbe6fe40000) 00000020:00000080:3.0:1789683510.207964:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789683510.208133:0:14427:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789683510.208141:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93ffa0c 00000020:00000080:0.0:1789683510.211650:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789683510.221432:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x59bee33f93ffa13 00000020:00000080:1.0:1789683510.222028:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789683510.222040:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683510.222046:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.222048:0:14427:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789683510.222051:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683510.222054:0:14427:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1789683510.222056:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683510.222057:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683510.222059:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683510.222061:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.222062:0:14427:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683510.222065:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683510.222069:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.222071:0:14427:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789683510.222076:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789683510.222108:0:14427:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789683510.222127:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683510.222130:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.222132:0:14427:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789683510.222135:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683510.222138:0:14427:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789683510.222141:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.222142:0:14427:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789683510.222145:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683510.222161:0:14427:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:1.0:1789683510.222195:0:14427:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789683510.222198:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683510.222223:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8dbe7d644d40) 00000020:00000080:1.0:1789683510.222236:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789683510.222243:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789683510.222303:0:14427:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789683510.222309:0:14427:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789683510.222316:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93ffa21 00010000:00080000:1.0:1789683510.222346:0:14427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbe4e9fd800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1789683510.226980:0:14427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789683510.228108:0:14427:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789683510.228291:0:14427:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789683510.229605:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683510.230339:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789683510.230419:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1789683510.230977:0:14431:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789683510.230983:0:14431:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789683510.232073:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683510.232085:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789683510.232116:0:14427:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789683510.232135:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93ffa28 00000100:00080000:1.0:1789683510.232146:0:14427:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683510.232354:0:14427:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dbe4e9fd800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1789683510.232392:0:14427:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe76136300 x1876618815564544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683510.232458:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815564544:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789683510.232509:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618815564544 offset 0 length 520: 4 00000100:00080000:1.0:1789683510.232568:0:14427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789683510.232631:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683510.232636:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.232637:0:14427:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789683510.232640:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683510.232642:0:14427:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789683510.232644:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683510.232654:0:14427:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683510.232655:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683510.232658:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.232659:0:14427:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683510.232662:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789683510.232666:0:14427:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789683510.232669:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.232698:0:14427:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789683510.232801:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789683510.232806:0:14427:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.160@tcp to nid 0x20000c0a8cba0 (192.168.203.160@tcp) 00000020:01000000:1.0:1789683510.232829:0:14427:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789683510.232832:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789683510.232845:0:14427:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8dbe7d640000) 00000020:00000080:1.0:1789683510.232858:0:14427:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789683510.232864:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789683510.232918:0:14427:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789683510.232924:0:14427:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789683510.232931:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x59bee33f93ffa36 00010000:00080000:1.0:1789683510.232958:0:14427:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbe59193800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1789683510.233191:0:14427:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789683510.233661:0:14427:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789683510.233892:0:14427:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789683510.234543:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683510.234611:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789683510.235310:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1789683510.236055:0:14433:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789683510.236060:0:14433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1789683510.237416:0:14427:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789683510.237428:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789683510.237463:0:14427:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789683510.237481:0:14427:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93ffa3d 00000100:00080000:1.0:1789683510.237492:0:14427:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683510.237503:0:14427:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dbe59193800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1789683510.237542:0:14427:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe76135c00 x1876618815564672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683510.237618:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815564672:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789683510.237923:0:14427:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000400:00000100:0.0:1789683510.238006:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618815564672 offset 0 length 520: 4 00000020:01000000:1.0:1789683510.238128:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683510.238133:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.238135:0:14427:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1789683510.238138:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683510.238141:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.238143:0:14427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789683510.238145:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789683510.238147:0:14427:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789683510.238160:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683510.238164:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.238165:0:14427:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789683510.238168:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683510.238171:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683510.238172:0:14427:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789683510.238176:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789683510.238220:0:14427:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14427:1876618815564800:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683510.238283:0:14427:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683510.238312:0:14427:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe62011300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683510.238422:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815564800 00000100:00100000:0.0:1789683510.238430:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815564800 00000100:00100000:0.0:1789683510.238474:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683510.238483:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+9:14427:x1876618815564800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683510.238751:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+9:14427:x1876618815564800:12345-0@lo:502:llog_process_th.0 Request processed in 268us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683510.238759:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683510.238826:0:14427:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14427:1876618815564800:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683510.238853:0:14427:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683510.238858:0:14427:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683510.238859:0:14427:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789683510.238863:0:14427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789683510.238916:0:14391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789683510.238934:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789683510.238948:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93ff9c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9cd expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.238959:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40ee00/0x59bee33f93ff9c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9cd expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683510.238978:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dbe529e1800 from 1 10000000:01000000:0.0:1789683510.238981:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789683510.239007:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.239014:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.239022:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.239037:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815564928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683510.239063:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.239078:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683510.239484:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815564928 00000100:00100000:1.0:1789683510.239491:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815564928 00000100:00100000:1.0:1789683510.239525:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683510.239532:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+9:14391:x1876618815564928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683510.239544:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683510.239557:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffa44 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683510.239579:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffa44 expref: 10 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683510.239603:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffa44 expref: 10 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683510.239611:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6800, rc 0) 00000100:00100000:1.0:1789683510.239643:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+10:14391:x1876618815564928:12345-0@lo:101:mount.lustre.0 Request processed in 111us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683510.239649:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789683510.239900:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815564928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683510.239914:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.239923:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.241147:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565056:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789683510.241346:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.241385:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683510.241412:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815565056 00000100:00100000:0.0:1789683510.241418:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815565056 00000100:00100000:0.0:1789683510.241524:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683510.241541:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+10:14391:x1876618815565056:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1789683510.241559:0:14403:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1789683510.241565:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1789683510.241631:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+10:14391:x1876618815565056:12345-0@lo:256:mount.lustre.0 Request processed in 92us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683510.241639:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683510.249760:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565056:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789683510.250499:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789683510.250614:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.250628:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683510.250636:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe529e1800 from 1 10000000:01000000:0.0:1789683510.250639:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683510.250708:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.250716:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.250727:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.250747:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565184:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683510.250810:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.250842:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683510.251151:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815565184 00000100:00100000:3.0:1789683510.251159:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815565184 00000100:00100000:3.0:1789683510.251217:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683510.251227:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+10:14391:x1876618815565184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683510.251423:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683510.251441:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffa52 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683510.251465:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffa52 expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683510.251475:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffa52 expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683510.251483:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8200, rc 0) 00000100:00100000:3.0:1789683510.251528:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+11:14391:x1876618815565184:12345-0@lo:101:mount.lustre.0 Request processed in 303us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683510.251536:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789683510.251915:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683510.251932:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.251942:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.251997:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565312:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683510.252403:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.252425:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789683510.254216:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815565312 00000100:00100000:3.0:1789683510.254229:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815565312 00000100:00100000:3.0:1789683510.254297:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789683510.254307:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+11:14391:x1876618815565312:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683510.254771:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+11:14391:x1876618815565312:12345-0@lo:501:mount.lustre.0 Request processed in 465us (2368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683510.254779:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789683510.254951:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565312:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683510.255016:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565440:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683510.255059:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683510.255089:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe62011600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683510.255104:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815565440 00000100:00100000:1.0:1789683510.255109:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815565440 00000100:00100000:1.0:1789683510.255132:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683510.255139:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+11:14391:x1876618815565440:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683510.255294:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+11:14391:x1876618815565440:12345-0@lo:503:mount.lustre.0 Request processed in 155us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683510.255301:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683510.255337:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565440:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683510.256555:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14435:1876618815565568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683510.256619:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.256655:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683510.256726:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815565568 00000100:00100000:1.0:1789683510.256733:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815565568 00000100:00100000:1.0:1789683510.256772:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683510.256781:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+11:14435:x1876618815565568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789683510.257000:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+11:14435:x1876618815565568:12345-0@lo:502:llog_process_th.0 Request processed in 221us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683510.257025:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789683510.257191:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14435:1876618815565568:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683510.257300:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683510.257310:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683510.257312:0:14435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789683510.257319:0:14435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe529e1800 00000020:00000080:0.0:1789683510.257322:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683510.257328:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683510.257330:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683510.257332:0:14435:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789683510.257334:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683510.257337:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683510.257338:0:14435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789683510.257341:0:14435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe529e1800 00000020:00000080:0.0:1789683510.257343:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683510.257400:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683510.257403:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683510.257410:0:14435:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789683510.257413:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683510.257415:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683510.257417:0:14435:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683510.257420:0:14435:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dbe529e1800 00000020:00000080:0.0:1789683510.257422:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789683510.257462:0:14435:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14435:1876618815565696:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683510.257498:0:14435:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.257519:0:14435:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7b952000 going to sleep for 11 seconds 00000100:00100000:2.0:1789683510.261897:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815565696 00000100:00100000:2.0:1789683510.261913:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815565696 00000100:00100000:2.0:1789683510.261975:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789683510.261984:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+11:14435:x1876618815565696:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683510.262326:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+11:14435:x1876618815565696:12345-0@lo:502:llog_process_th.0 Request processed in 342us (4825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683510.262345:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789683510.262490:0:14435:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1af100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14435:1876618815565696:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789683510.262526:0:14435:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683510.262533:0:14435:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683510.262536:0:14435:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789683510.262540:0:14435:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789683510.263292:0:14391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789683510.263314:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683510.263341:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.263354:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683510.263392:0:14391:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789683510.263395:0:14391:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dbe529e1800 10000000:01000000:2.0:1789683510.263398:0:14391:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dbe529e1800 10000000:01000000:2.0:1789683510.263403:0:14391:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789683510.263409:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe529e1800 from 1 10000000:01000000:2.0:1789683510.263412:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789683510.263444:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908400/0x59bee33f93ffa60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.263452:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908400/0x59bee33f93ffa60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.263461:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908400/0x59bee33f93ffa60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683510.263481:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789683510.263530:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683510.263560:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683510.263665:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815565824 00000100:00100000:0.0:1789683510.263694:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815565824 00000100:00100000:0.0:1789683510.263726:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789683510.263733:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+11:14391:x1876618815565824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683510.263747:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683510.263760:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40e000/0x59bee33f93ffa67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffa60 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.263781:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40e000/0x59bee33f93ffa67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffa60 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.263791:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40e000/0x59bee33f93ffa67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffa60 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.263798:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e000, rc 0) 00000100:00100000:0.0:1789683510.263832:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:14391:x1876618815565824:12345-0@lo:101:mount.lustre.0 Request processed in 99us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683510.263848:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789683510.263939:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565824:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683510.263952:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908400/0x59bee33f93ffa60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa67 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.263967:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908400/0x59bee33f93ffa60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffa67 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683510.264292:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565952:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683510.264322:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683510.264350:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683510.265080:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815565952 00000100:00100000:0.0:1789683510.265088:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815565952 00000100:00100000:0.0:1789683510.265123:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789683510.265132:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+12:14391:x1876618815565952:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683510.265416:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+12:14391:x1876618815565952:12345-0@lo:501:mount.lustre.0 Request processed in 284us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683510.265423:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789683510.265564:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799caa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815565952:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683510.265602:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815566080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683510.265644:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683510.265708:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496039c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683510.267798:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815566080 00000100:00100000:0.0:1789683510.267815:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815566080 00000100:00100000:0.0:1789683510.267871:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789683510.267881:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe59f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:14391:x1876618815566080:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683510.268116:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe59f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:14391:x1876618815566080:12345-0@lo:503:mount.lustre.0 Request processed in 236us (2471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683510.268124:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789683510.276229:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b918e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815566080:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683510.280933:0:14440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b918e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14440:1876618815566208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683510.281003:0:14440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683510.281039:0:14440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe49603d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683510.281739:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815566208 00000100:00100000:2.0:1789683510.281748:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815566208 00000100:00100000:2.0:1789683510.281787:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789683510.281797:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe4a7b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:14440:x1876618815566208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789683510.282075:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe4a7b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:14440:x1876618815566208:12345-0@lo:502:llog_process_th.0 Request processed in 279us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683510.282083:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789683510.285439:0:14440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b918e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14440:1876618815566208:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789683510.285531:0:14440:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789683510.285549:0:14440:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8dbe6fe44d40) 00000020:00000080:3.0:1789683510.285569:0:14440:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1789683510.285656:0:14440:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe529e1800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789683510.285661:0:14440:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dbe529e1800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789683510.285663:0:14440:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe529e1800 4 00010000:00080000:3.0:1789683510.285713:0:14440:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbe75e58000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.160@tcp at head 00010000:00010000:3.0:1789683510.287386:0:14440:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789683510.296353:0:14440:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789683510.296392:0:14440:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789683510.296405:0:14440:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x59bee33f93ffa75 00000100:00080000:3.0:1789683510.296416:0:14440:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789683510.296427:0:14440:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dbe75e58000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1789683510.296463:0:14440:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe7b918e00 x1876618815566336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789683510.296493:0:14440:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789683510.300694:0:14440:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14440:1876618815566464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789683510.300779:0:14440:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683510.300817:0:14440:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53ff5900 going to sleep for 11 seconds 00000100:00100000:0.0:1789683510.301715:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815566336:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789683510.301774:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.301817:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815566464 00000100:00100000:0.0:1789683510.301824:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815566464 00000100:00100000:0.0:1789683510.301870:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683510.301879:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+12:14440:x1876618815566464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789683510.302289:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+12:14440:x1876618815566464:12345-0@lo:502:llog_process_th.0 Request processed in 410us (1509us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683510.302298:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789683510.302367:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815566336 00000100:00100000:0.0:1789683510.302378:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815566336 00000100:00100000:0.0:1789683510.302399:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683510.302403:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876618815566336:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789683510.302446:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876618815566336:12345-0@lo:38:llog_process_th.0 Request processed in 41us (672us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789683510.302452:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683510.302487:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683510.302495:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe75e58000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683510.302498:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789683510.302502:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b918e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815566336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789683510.302608:0:14440:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:267f495e-c971-4db4-b237-3907c961127d:14440:1876618815566464:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789683510.302643:0:14440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789683510.303326:0:14391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789683510.303348:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789683510.303366:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908400/0x59bee33f93ffa60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa67 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.303378:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908400/0x59bee33f93ffa60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa67 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789683510.303419:0:14391:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789683510.303422:0:14391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789683510.303423:0:14391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683510.303424:0:14391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683510.303425:0:14391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683510.303427:0:14391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683510.303428:0:14391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683510.303434:0:14391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789683510.303436:0:14391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683510.303437:0:14391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683510.303441:0:14391:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1789683510.303443:0:14391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789683510.303445:0:14391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789683510.303446:0:14391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683510.303447:0:14391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683510.303448:0:14391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683510.303449:0:14391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683510.303450:0:14391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683510.303451:0:14391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789683510.303452:0:14391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683510.303453:0:14391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789683510.303475:0:14391:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1789683510.303490:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815566592:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789683510.303541:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683510.303570:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53b5b240 going to sleep for 11 seconds 00000100:00100000:0.0:1789683510.304144:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815566592 00000100:00100000:0.0:1789683510.304152:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815566592 00000100:00100000:0.0:1789683510.304189:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789683510.304197:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:14391:x1876618815566592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789683510.304309:0:14404:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789683510.304322:0:14404:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789683510.376355:0:14404:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789683510.376374:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789683510.376436:0:14425:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789683510.376441:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789683510.376465:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.376486:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffa44 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.376494:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.376539:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93ffa44 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.376554:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93ffa44 expref: 12 pid: 14402 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683510.376588:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876618815566720:0@lo:104: 00000100:00100000:2.0:1789683510.376663:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683510.376740:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7bf34840 going to sleep for 11 seconds 00000100:00100000:1.0:1789683510.376794:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815566720 00000100:00100000:1.0:1789683510.376802:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815566720 00000100:00100000:1.0:1789683510.376851:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683510.376861:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:267f495e-c971-4db4-b237-3907c961127d+3:14425:x1876618815566720:12345-0@lo:104: 00010000:00010000:1.0:1789683510.376874:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683510.376931:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789683510.376935:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cb800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876618815566720:0@lo:104: 00000100:00100000:1.0:1789683510.376937:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:267f495e-c971-4db4-b237-3907c961127d+3:14425:x1876618815566720:12345-0@lo:104: Request processed in 78us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683510.376943:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789683510.376952:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.376991:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683510.376998:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377005:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f200 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683510.377079:0:14398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377087:0:14398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683510.377220:0:14398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683510.377226:0:14398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683510.377267:0:14398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377273:0:14398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683510.377296:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377304:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f200/0x59bee33f93ffa44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffa4b expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683510.377313:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1789683510.377319:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683510.377321:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683510.377322:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815566848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683510.377322:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683510.377364:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683510.377415:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815566848 00000100:00100000:0.0:1789683510.377420:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815566848 00010000:00010000:0.0:1789683510.377439:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffa44 expref: 13 pid: 14402 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.377462:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683510.377468:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:267f495e-c971-4db4-b237-3907c961127d+13:3303:x1876618815566848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683510.377478:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683510.377482:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffa44 expref: 13 pid: 14402 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377491:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93ffa44 expref: 13 pid: 14402 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377509:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe76fc6800/0x59bee33f93ffa4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93ffa44 expref: 13 pid: 14402 timeout: 544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377521:0:14394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377529:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789683510.377542:0:14394:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001101860s 00010000:00010000:0.0:1789683510.377546:0:14394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377553:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377566:0:14394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377573:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377578:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909000 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683510.377581:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377588:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377598:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683510.377630:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683510.377667:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:267f495e-c971-4db4-b237-3907c961127d+12:3303:x1876618815566848:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683510.377693:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789683510.377756:0:14425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683510.377758:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815566848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683510.377764:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683510.377771:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7b909000/0x59bee33f93ffa7c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683510.388093:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+11:14391:x1876618815566592:12345-0@lo:253:mount.lustre.0 Request processed in 83887us (84541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683510.388111:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789683510.388255:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:14391:1876618815566592:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789683510.388275:0:14391:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789683510.388279:0:14391:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789683510.388281:0:14391:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789683510.388283:0:14391:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683510.388284:0:14391:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683510.388285:0:14391:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683510.388287:0:14391:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683510.388288:0:14391:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789683510.388290:0:14391:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789683510.388292:0:14391:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683510.388294:0:14391:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789683510.388315:0:14391:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789683510.402059:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789683510.404312:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789683510.405123:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789683510.406621:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789683510.407913:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789683510.408083:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1789683510.409219:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1789683510.409408:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1789683510.409655:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1789683510.409926:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1789683510.410186:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1789683510.410352:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1789683510.462575:0:14391:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1789683510.463538:0:14391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1789683510.466348:0:14448:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1789683510.466462:0:14448:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:3.0:1789683510.469859:0:14391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789683510.470009:0:14391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789683510.470425:0:14391:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789683510.470432:0:14391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789683510.470550:0:14391:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683510.473949:0:14448:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789683510.474032:0:14448:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789683510.474037:0:14448:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:2.0:1789683510.474992:0:14447:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1789683510.475012:0:14447:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:3.0:1789683510.475437:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789683510.476478:0:14391:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789683510.476531:0:14391:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789683510.482074:0:14391:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789683510.493055:0:14391:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1789683510.558630:0:14391:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1789683510.558669:0:14391:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9e3e41d8f988 00100000:10000000:3.0:1789683510.558716:0:14391:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789683510.561114:0:14391:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683510.561137:0:14391:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683510.561153:0:14391:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789683510.561170:0:14391:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1789683510.885715:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683511.328425:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1789683511.328984:0:14406:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789683511.328988:0:14406:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dbe529e1800 from 6 10000000:01000000:2.0:1789683511.328991:0:14406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789683511.329035:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.329046:0:14406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683511.329057:0:14406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683511.329081:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815566976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683511.329150:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683511.329198:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7bf34b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683511.329438:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815566976 00000100:00100000:0.0:1789683511.329446:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815566976 00000100:00100000:0.0:1789683511.329502:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789683511.329511:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+11:14406:x1876618815566976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683511.329527:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683511.329540:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffa83 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.329563:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffa83 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.329573:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffa83 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.329599:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f000, rc 0) 00000100:00100000:0.0:1789683511.329818:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:14406:x1876618815566976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 308us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683511.329825:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789683511.333058:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815566976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683511.333089:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.333100:0:14406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683511.333196:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815567104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1789683511.333281:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683511.333330:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53ff5f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789683511.333564:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815567104 00000100:00100000:0.0:1789683511.333571:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815567104 00000100:00100000:0.0:1789683511.333625:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789683511.333635:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:14406:x1876618815567104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789683511.333656:0:14404:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683511.333880:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683511.333884:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789683511.333985:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:14406:x1876618815567104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 350us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683511.333993:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789683511.334304:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b919180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815567104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1789683511.334358:0:14406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789683511.334366:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683511.334375:0:14406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683511.904016:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789683512.355300:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789683512.928011:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683513.955229:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683514.975917:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789683515.360368:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683515.360376:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683515.360379:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789683515.360382:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789683515.360385:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789683515.360388:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789683515.360391:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dbe75e58000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789683515.360408:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8dbe75e58000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:3.0:1789683515.360430:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe7b91bb80 x1876618815567360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683515.360574:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815567232:0@lo:400:kworker.0 00000100:00100000:0.0:1789683515.360659:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683515.360740:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815567360:0@lo:38:kworker.0 00000100:00100000:0.0:1789683515.360768:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683515.360945:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815567232 00000100:00100000:3.0:1789683515.360965:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815567232 00000100:00100000:3.0:1789683515.361011:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789683515.361019:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:3303:x1876618815567232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683515.361076:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:3303:x1876618815567232:12345-0@lo:400:kworker.0 Request processed in 57us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683515.361083:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789683515.361198:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b919180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815567232:0@lo:400:kworker.0 00000100:00100000:2.0:1789683515.363160:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815567360 00000100:00100000:2.0:1789683515.363172:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815567360 00000100:00100000:2.0:1789683515.363282:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683515.363290:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876618815567360:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789683515.363316:0:14411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1789683515.363351:0:14411:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x59bee33f93ffa91 00000004:00100000:2.0:1789683515.363367:0:14411:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789683515.363487:0:14411:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9e9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683515.363568:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876618815567360:12345-0@lo:38:kworker.0 Request processed in 278us (2798us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683515.363575:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789683515.363655:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dbe7b91bb80 x1876618815567360/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683515.363688:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1789683515.363696:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1789683515.363701:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789683515.363716:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe75e58000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789683515.363724:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876618815567360:0@lo:38:kworker.0 00000001:02000400:2.0:1789683515.721206:0:14691:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789683516.009109:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683517.023939:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683518.055853:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789683518.841659:0:14841:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffff59afa60 20000000:00000080:1.0:1789683518.841754:0:14841:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dbe47814c00 uarg=0000000000000000 20000000:01000000:1.0:1789683518.841786:0:14841:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789683518.841792:0:14841:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789683518.841797:0:14841:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789683518.842969:0:14842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1789683518.843099:0:14841:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789683518.854705:0:14841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789683518.854741:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.854760:0:14841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffa52 expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683518.854768:0:14841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.858517:0:14841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93ffa52 expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.858538:0:14841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93ffa52 expref: 11 pid: 14404 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683518.858555:0:14841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14841:1876618815567488:0@lo:104: 00000100:00100000:2.0:1789683518.858627:0:14841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683518.858698:0:14841:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bb180 going to sleep for 11 seconds 00000100:00100000:1.0:1789683518.858732:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815567488 00000100:00100000:1.0:1789683518.858740:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815567488 00000100:00100000:1.0:1789683518.858792:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683518.858801:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:267f495e-c971-4db4-b237-3907c961127d+3:14841:x1876618815567488:12345-0@lo:104: 00010000:00010000:1.0:1789683518.858815:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.858882:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683518.858888:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:267f495e-c971-4db4-b237-3907c961127d+3:14841:x1876618815567488:12345-0@lo:104: Request processed in 89us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683518.858894:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683518.858962:0:14841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14841:1876618815567488:0@lo:104: 00010000:00010000:2.0:1789683518.858983:0:14841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.861350:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683518.861362:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.861374:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fe00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683518.861378:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.861388:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683518.861395:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683518.861401:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789683518.861462:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.861468:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683518.861499:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.861505:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40fe00/0x59bee33f93ffa52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffa59 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683518.861526:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683518.861527:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683518.861529:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683518.861586:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:267f495e-c971-4db4-b237-3907c961127d:3304:1876618815567616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683518.861667:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683518.861765:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815567616 00000100:00100000:1.0:1789683518.861772:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815567616 00010000:00010000:1.0:1789683518.861798:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffa52 expref: 12 pid: 14404 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683518.861832:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683518.861839:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:267f495e-c971-4db4-b237-3907c961127d+12:3304:x1876618815567616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683518.861850:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683518.861855:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffa52 expref: 12 pid: 14404 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861867:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93ffa52 expref: 12 pid: 14404 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861891:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea8200/0x59bee33f93ffa59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93ffa52 expref: 12 pid: 14404 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861905:0:14394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861914:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861928:0:14394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861935:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861942:0:14394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861949:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861954:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8e00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683518.861958:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861965:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.861982:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683518.862001:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683518.862032:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:267f495e-c971-4db4-b237-3907c961127d+11:3304:x1876618815567616:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683518.862056:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789683518.862059:0:14841:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.862072:0:14841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683518.862079:0:14841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffa98 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683518.862203:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:267f495e-c971-4db4-b237-3907c961127d:3304:1876618815567616:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683519.071822:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683520.098339:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683520.479845:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683510/real 1789683510] req@ffff8dbe76135c00 x1876618815564672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683520.479877:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dbe76135c00 x1876618815564672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683520 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683520.479887:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683510/real 1789683510] req@ffff8dbe76136300 x1876618815564544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683520 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683520.479897:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dbe76136300 x1876618815564544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683520 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789683520.479915:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe59193800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683520.479934:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789683520.479938:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815564672:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789683520.479944:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9fd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789683520.479949:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789683520.479952:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815564544:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789683520.480268:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683520.480273:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789683520.480276:0:37:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9fd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683520.480281:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1789683520.480300:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789683520.480309:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dbe4e9fd800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1789683520.480327:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe799c9c00 x1876618815567872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789683520.480340:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683520.480342:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789683520.480344:0:37:0:(import.c:65:import_set_state_nolock()) ffff8dbe59193800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789683520.480348:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 443 00000100:00080000:2.0:1789683520.480350:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789683520.480354:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dbe59193800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:2.0:1789683520.480364:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe799ca300 x1876618815568000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683520.480487:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815567744:0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.480548:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683520.480610:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815568128:0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.480634:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683520.480686:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815568128 00000100:00100000:0.0:1789683520.480693:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815568128 00000100:00100000:0.0:1789683520.480730:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683520.480737:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815568128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.480786:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815568128:12345-0@lo:400:kworker.0 Request processed in 49us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.480793:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789683520.480839:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dbe799cb480 x1876618815568128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683536 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683520.480850:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815568128:0@lo:400:kworker.0 00000100:00100000:0.0:1789683520.480866:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815567872:0@lo:8:kworker.0 00000400:00000100:0.0:1789683520.480883:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618815567872 offset 0 length 520: 4 00000100:00100000:0.0:1789683520.480901:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815568000:0@lo:8:kworker.0 00000400:00000100:0.0:1789683520.480912:0:3301:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876618815568000 offset 0 length 520: 4 00000100:00100000:2.0:1789683520.481023:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815567744 00000100:00100000:2.0:1789683520.481028:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815567744 00000100:00100000:2.0:1789683520.481065:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683520.481072:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+11:3305:x1876618815567744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683520.481108:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+11:3305:x1876618815567744:12345-0@lo:400:kworker.0 Request processed in 37us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683520.481115:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789683520.481207:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815567744:0@lo:400:kworker.0 10000000:01000000:2.0:1789683520.865017:0:14406:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789683520.865026:0:14406:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe529e1800 from 10 10000000:01000000:2.0:1789683520.865032:0:14406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789683520.865083:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683520.865095:0:14406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683520.865123:0:14406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683520.866074:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815568256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789683520.868785:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683520.870358:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815568256 00000100:00100000:0.0:1789683520.870372:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815568256 00000100:00100000:0.0:1789683520.870433:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789683520.870443:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+11:14406:x1876618815568256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789683520.870460:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683520.870485:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffa9f expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683520.870514:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffa9f expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683520.870526:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffa9f expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683520.870553:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ec00, rc 0) 00000100:00100000:0.0:1789683520.870614:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+12:14406:x1876618815568256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (1837us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.870621:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789683520.873402:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53e92d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683520.873453:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815568256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683520.873479:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683520.873492:0:14406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683520.873588:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815568384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683520.873667:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683520.873711:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe49603840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683520.875245:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815568384 00000100:00100000:0.0:1789683520.875256:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815568384 00000100:00100000:0.0:1789683520.875382:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683520.875394:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:14406:x1876618815568384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683520.875959:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:14406:x1876618815568384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 567us (2291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683520.875968:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789683520.876025:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815568384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683520.876080:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815568512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683520.876122:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683520.876141:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5305dc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683520.876830:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815568512 00000100:00100000:1.0:1789683520.876840:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815568512 00000100:00100000:1.0:1789683520.876893:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789683520.876901:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:14406:x1876618815568512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683520.877102:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:14406:x1876618815568512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 202us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683520.877110:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789683520.877183:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1adf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815568512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789683520.877867:0:14910:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789683520.877926:0:14406:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789683520.877946:0:14406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683520.877957:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683520.877968:0:14406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683521.120354:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683522.143887:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683522.602468:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789683523.169654:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683524.199665:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789683524.526936:0:15091:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789683524.526941:0:15091:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789683524.527078:0:15091:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dbe75e5a000 00000020:01000004:0.0:1789683524.527095:0:15091:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789683524.527106:0:15091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789683524.527129:0:15091:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8dbe6bfd3380) 00000020:00000080:0.0:1789683524.527158:0:15091:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789683524.572386:0:15091:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789683524.573028:0:15091:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789683524.574403:0:15091:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789683524.576025:0:15091:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789683524.576781:0:15091:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789683524.579368:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:3.0:1789683524.579653:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:3.0:1789683524.579777:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:3.0:1789683524.580308:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 405: rc = 0 00100000:10000000:3.0:1789683524.580569:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 405: rc = 0 00100000:10000000:3.0:1789683524.580893:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 405: rc = 0 00100000:10000000:3.0:1789683524.581173:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 405: rc = 0 00100000:10000000:3.0:1789683524.581424:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 405: rc = 0 00100000:10000000:3.0:1789683524.581659:0:15091:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 405: rc = 0 00000020:00000080:3.0:1789683524.582271:0:15091:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789683524.582282:0:15091:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683524.582293:0:15091:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x59bee33f93ffab4 00000020:01000004:3.0:1789683524.582301:0:15091:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789683524.582324:0:15091:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789683524.582327:0:15091:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789683524.582333:0:15091:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789683524.582338:0:15091:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789683524.582350:0:15091:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8dbe6fe43380) 00000020:00000080:3.0:1789683524.582360:0:15091:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789683524.589422:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789683524.595102:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789683524.595117:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789683524.595903:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683524.595911:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789683524.599334:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789683524.599347:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789683524.610393:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683524.610593:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789683524.610599:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789683524.611250:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789683524.611259:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789683524.654280:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683524.654519:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789683524.654527:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789683524.656526:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789683524.656539:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789683524.664753:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789683524.664768:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789683524.668008:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789683524.668335:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789683524.668341:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789683524.669405:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789683524.669415:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789683524.715435:0:15091:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789683524.715643:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789683524.715650:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789683524.718495:0:15091:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789683524.718512:0:15091:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789683524.719290:0:15091:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789683524.719315:0:15091:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789683524.719321:0:15091:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789683524.743018:0:15091:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789683524.743062:0:15091:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.160@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789683524.743066:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789683524.743068:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683524.743069:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683524.743071:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683524.743072:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683524.743073:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683524.743075:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683524.743077:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683524.743078:0:15091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683524.743082:0:15091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789683524.743084:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683524.743086:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683524.743087:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683524.743088:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683524.743089:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683524.743090:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683524.743092:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683524.743093:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683524.743094:0:15091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789683524.743209:0:15091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789683524.743233:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815568640:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789683524.743411:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.743510:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe483cf540 going to sleep for 11 seconds 00000100:00100000:1.0:1789683524.743562:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815568640 00000100:00100000:1.0:1789683524.743570:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815568640 00000100:00100000:1.0:1789683524.743658:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789683524.743668:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:15091:x1876618815568640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789683524.743729:0:14404:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789683524.743742:0:14404:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789683524.743751:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789683524.751010:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:15091:x1876618815568640:12345-0@lo:253:mount.lustre.0 Request processed in 7334us (7589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683524.751039:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789683524.751223:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815568640:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789683524.751241:0:15091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789683524.751245:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789683524.751246:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789683524.751247:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683524.751249:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683524.751250:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683524.751251:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683524.751253:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683524.751255:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683524.751256:0:15091:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789683524.751396:0:15091:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dbe75e5a000 from lustre-OST0000 10000000:01000000:0.0:1789683524.751429:0:15091:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789683524.751432:0:15091:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789683524.751439:0:15091:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dbe48c64d40 local copy 00010000:00010000:0.0:1789683524.751448:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683524.752035:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815568768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683524.752090:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.752250:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683524.752298:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815568768 00000100:00100000:3.0:1789683524.752305:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815568768 00000100:00100000:3.0:1789683524.752387:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789683524.752396:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:15091:x1876618815568768:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683524.752624:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+12:15091:x1876618815568768:12345-0@lo:501:mount.lustre.0 Request processed in 229us (533us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789683524.752632:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789683524.752947:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815568768:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789683524.753244:0:15091:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789683524.753515:0:15091:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789683524.753523:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683524.753535:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683524.753562:0:15091:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dbe75e5a000 10000000:01000000:2.0:1789683524.753567:0:15091:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789683524.753572:0:15091:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8dbe48c64d40 10000000:01000000:2.0:1789683524.753574:0:15091:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1789683524.753577:0:15091:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8dbe48c64d40 from 1 10000000:01000000:2.0:1789683524.753581:0:15091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1789683524.753612:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909000/0x59bee33f93ffac2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683524.753620:0:15091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909000/0x59bee33f93ffac2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683524.753630:0:15091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909000/0x59bee33f93ffac2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683524.753647:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815568896:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683524.760240:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683524.760339:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83000 going to sleep for 11 seconds 00000100:00100000:2.0:1789683524.763321:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815568896 00000100:00100000:2.0:1789683524.763336:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815568896 00000100:00100000:3.0:1789683524.767174:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789683524.767188:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+12:15091:x1876618815568896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683524.767207:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683524.767227:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea9600/0x59bee33f93ffac9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffac2 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683524.767256:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea9600/0x59bee33f93ffac9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffac2 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683524.767268:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea9600/0x59bee33f93ffac9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffac2 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683524.767278:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea9600, rc 0) 00000100:00100000:3.0:1789683524.767365:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+13:15091:x1876618815568896:12345-0@lo:101:mount.lustre.0 Request processed in 180us (7132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683524.767372:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789683524.767500:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815568896:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683524.767516:0:15091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909000/0x59bee33f93ffac2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffac9 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.767525:0:15091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909000/0x59bee33f93ffac2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffac9 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683524.767546:0:15091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1789683524.767568:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909000/0x59bee33f93ffac2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffac9 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.767576:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909000/0x59bee33f93ffac2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffac9 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683524.767585:0:15091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1789683524.767591:0:15091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789683524.767596:0:15091:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1789683524.767612:0:15091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789683524.767641:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6e00/0x59bee33f93ffad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.767649:0:15091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6e00/0x59bee33f93ffad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.767656:0:15091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6e00/0x59bee33f93ffad0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683524.767705:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569024:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683524.767756:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683524.767783:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe60946480 going to sleep for 11 seconds 00000100:00100000:3.0:1789683524.768196:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815569024 00000100:00100000:3.0:1789683524.768204:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815569024 00000100:00100000:3.0:1789683524.768241:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789683524.768249:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+13:15091:x1876618815569024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683524.768258:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683524.768275:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8c00/0x59bee33f93ffad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffad0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683524.768292:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8c00/0x59bee33f93ffad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffad0 expref: 14 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683524.768301:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea8c00/0x59bee33f93ffad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffad0 expref: 14 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683524.768307:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8c00, rc 0) 00000100:00100000:3.0:1789683524.768393:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569024:12345-0@lo:101:mount.lustre.0 Request processed in 144us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683524.768400:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789683524.769603:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683524.769638:0:15091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6e00/0x59bee33f93ffad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffad7 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683524.769649:0:15091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6e00/0x59bee33f93ffad0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffad7 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683524.770615:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789683524.777368:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683524.777661:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789683524.777759:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789683524.777793:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789683524.778186:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789683524.778233:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789683524.778268:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789683524.778334:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789683524.778342:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789683524.778434:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683524.778500:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683524.779458:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683524.782034:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815569152 00000100:00100000:3.0:1789683524.782050:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815569152 00000100:00100000:3.0:1789683524.782231:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789683524.782243:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683524.782704:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569152:12345-0@lo:501:mount.lustre.0 Request processed in 463us (4202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683524.782713:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789683524.783011:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683524.783059:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789683524.784884:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683524.789012:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683524.789275:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815569280 00000100:00100000:0.0:1789683524.789284:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815569280 00000100:00100000:0.0:1789683524.789335:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789683524.789345:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569280:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683524.789785:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569280:12345-0@lo:503:mount.lustre.0 Request processed in 440us (4906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683524.789793:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789683524.791372:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789683524.792798:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683524.792882:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683524.792950:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683524.792996:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52f83840 going to sleep for 11 seconds 00000100:00100000:0.0:1789683524.796090:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815569408 00000100:00100000:0.0:1789683524.796110:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815569408 00000100:00100000:0.0:1789683524.796174:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789683524.796185:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683524.796512:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569408:12345-0@lo:502:mount.lustre.0 Request processed in 328us (3560us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683524.796520:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789683524.797373:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569408:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683524.797983:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789683524.798048:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789683524.798085:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789683524.798134:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789683524.798184:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789683524.798236:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789683524.798295:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789683524.798332:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789683524.798366:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1789683524.798407:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1789683524.798450:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1789683524.798493:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1789683524.798534:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569536:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683524.798604:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683524.798657:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53ff5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683524.800781:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815569536 00000100:00100000:2.0:1789683524.800794:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815569536 00000100:00100000:2.0:1789683524.800859:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789683524.800869:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683524.801383:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569536:12345-0@lo:502:mount.lustre.0 Request processed in 515us (2777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683524.801390:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789683524.802066:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569536:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683524.802215:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1789683524.802232:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789683524.804128:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683524.804165:0:15105:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789683524.804173:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683524.804176:0:15105:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789683524.804183:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683524.804208:0:15105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8dbd445319c0) 00000020:00000080:3.0:1789683524.804235:0:15105:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789683524.804242:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789683524.804515:0:15105:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe75e5a000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789683524.804524:0:15105:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789683524.804532:0:15105:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x59bee33f93ffae5 00010000:00010000:3.0:1789683524.810488:0:15105:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789683524.811357:0:15105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1789683524.814092:0:15105:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789683524.820079:0:15105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789683524.820094:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683524.820610:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683524.820613:0:15105:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789683524.820619:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789683524.820622:0:15105:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789683524.820624:0:15105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683524.820625:0:15105:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789683524.820627:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789683524.820630:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683524.820631:0:15105:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789683524.820634:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683524.820636:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683524.820638:0:15105:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789683524.820641:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789683524.820643:0:15105:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789683524.820645:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683524.820648:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683524.820649:0:15105:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789683524.820651:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683524.820663:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683524.820664:0:15105:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789683524.820696:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789683524.820781:0:15105:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683524.820785:0:15105:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683524.820786:0:15105:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789683524.820790:0:15105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789683524.823519:0:15091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789683524.823551:0:15091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789683524.823618:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6e00/0x59bee33f93ffad0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffad7 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683524.823647:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6e00/0x59bee33f93ffad0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffad7 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683524.823656:0:15091:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe75e5a000 from 1 10000000:01000000:0.0:1789683524.823659:0:15091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789683524.823724:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683524.823740:0:15091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683524.823758:0:15091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683524.823787:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569664:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789683524.823923:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.823964:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683524.825108:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815569664 00000100:00100000:1.0:1789683524.825119:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815569664 00000100:00100000:1.0:1789683524.825178:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789683524.825188:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+14:15091:x1876618815569664:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683524.825205:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683524.825220:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffaec expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.825246:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffaec expref: 15 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.825257:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffaec expref: 15 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.825266:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7000, rc 0) 00000100:00100000:1.0:1789683524.825327:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815569664:12345-0@lo:101:mount.lustre.0 Request processed in 141us (1403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683524.825333:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789683524.825457:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569664:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683524.825474:0:15091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683524.825483:0:15091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683524.826773:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789683524.827705:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683524.839872:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789683524.839990:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789683524.840131:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789683524.840150:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789683524.840258:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683524.840331:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.840372:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683524.840829:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815569792 00000100:00100000:1.0:1789683524.840837:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815569792 00000100:00100000:1.0:1789683524.840883:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789683524.840893:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815569792:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683524.841147:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815569792:12345-0@lo:501:mount.lustre.0 Request processed in 247us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683524.841165:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789683524.841434:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569792:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683524.841474:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569920:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683524.841517:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.841548:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683524.841602:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815569920 00000100:00100000:3.0:1789683524.841608:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815569920 00000100:00100000:3.0:1789683524.841638:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789683524.841647:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815569920:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683524.841944:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815569920:12345-0@lo:503:mount.lustre.0 Request processed in 297us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683524.841952:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789683524.842040:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815569920:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789683524.842656:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683524.842774:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570048:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683524.843232:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.843320:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683524.846215:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815570048 00000100:00100000:3.0:1789683524.846230:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815570048 00000100:00100000:3.0:1789683524.847134:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789683524.847158:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815570048:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683524.847435:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815570048:12345-0@lo:502:mount.lustre.0 Request processed in 282us (4202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683524.847443:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789683524.847531:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570048:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683524.847895:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789683524.847964:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789683524.848028:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789683524.848066:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789683524.848100:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789683524.848177:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789683524.848217:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789683524.848251:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789683524.848289:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570176:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683524.848342:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683524.849282:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815570176 00000100:00100000:1.0:1789683524.849293:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815570176 00000100:00100000:0.0:1789683524.850749:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683524.850992:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789683524.851013:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815570176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683524.851306:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815570176:12345-0@lo:502:mount.lustre.0 Request processed in 300us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683524.851314:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789683524.851551:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570176:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683524.851775:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1789683524.851789:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789683524.853400:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683524.853415:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683524.853417:0:15109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789683524.853425:0:15109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe75e5a000 00000020:00000080:0.0:1789683524.853427:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683524.853434:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683524.853437:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683524.853438:0:15109:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789683524.853440:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683524.853443:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683524.853444:0:15109:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789683524.853447:0:15109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe75e5a000 00000020:00000080:0.0:1789683524.853449:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683524.853551:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683524.853555:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683524.853557:0:15109:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789683524.853560:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683524.853562:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683524.853564:0:15109:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683524.853568:0:15109:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dbe75e5a000 00000020:00000080:0.0:1789683524.853570:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683524.854333:0:15109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683524.854340:0:15109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683524.854341:0:15109:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789683524.854345:0:15109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1789683524.854486:0:15091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1789683524.854514:0:15091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683524.854531:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.854544:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683524.854586:0:15091:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789683524.854589:0:15091:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dbe75e5a000 10000000:01000000:1.0:1789683524.854593:0:15091:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dbe75e5a000 10000000:01000000:1.0:1789683524.854597:0:15091:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789683524.854603:0:15091:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe75e5a000 from 1 10000000:01000000:1.0:1789683524.854606:0:15091:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789683524.854641:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7e00/0x59bee33f93ffafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.854651:0:15091:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7e00/0x59bee33f93ffafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.854662:0:15091:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7e00/0x59bee33f93ffafa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683524.854730:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789683524.854958:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683524.855004:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe60946600 going to sleep for 11 seconds 00000100:00100000:0.0:1789683524.855334:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815570304 00000100:00100000:0.0:1789683524.855341:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815570304 00000100:00100000:0.0:1789683524.855379:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789683524.855389:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815570304:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683524.855415:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683524.855428:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40e400/0x59bee33f93ffb01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffafa expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683524.855454:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40e400/0x59bee33f93ffb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffafa expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683524.855464:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40e400/0x59bee33f93ffb01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffafa expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683524.855473:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40e400, rc 0) 00000100:00100000:0.0:1789683524.855523:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815570304:12345-0@lo:101:mount.lustre.0 Request processed in 136us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683524.855530:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789683524.855635:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683524.855649:0:15091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7e00/0x59bee33f93ffafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffb01 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.855658:0:15091:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7e00/0x59bee33f93ffafa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffb01 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683524.856571:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1789683524.864704:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789683524.868572:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789683524.868660:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789683524.868724:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789683524.868814:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789683524.868856:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789683524.868945:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789683524.868986:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789683524.869023:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789683524.869076:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789683524.869135:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789683524.869186:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789683524.869251:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789683524.869289:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789683524.869320:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789683524.869366:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789683524.869403:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789683524.869449:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789683524.869501:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789683524.869538:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789683524.869570:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789683524.869612:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789683524.869662:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789683524.869769:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789683524.869819:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789683524.869854:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789683524.869887:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789683524.869935:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789683524.869969:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789683524.870048:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789683524.870056:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1789683524.870176:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683524.870238:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.870278:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683524.872047:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815570432 00000100:00100000:2.0:1789683524.872059:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815570432 00000100:00100000:2.0:1789683524.874926:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789683524.874944:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815570432:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683524.875262:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815570432:12345-0@lo:501:mount.lustre.0 Request processed in 323us (5022us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683524.875269:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789683524.875423:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570432:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683524.875470:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570560:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683524.875513:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.877611:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683524.884975:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815570560 00000100:00100000:1.0:1789683524.884990:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815570560 00000100:00100000:1.0:1789683524.885047:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789683524.885059:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815570560:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683524.885339:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815570560:12345-0@lo:503:mount.lustre.0 Request processed in 281us (9823us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683524.885347:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789683524.888934:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570560:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789683524.892996:0:15091:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683524.893083:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570688:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683524.894008:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.894062:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789683524.894221:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815570688 00000100:00100000:3.0:1789683524.894229:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815570688 00000100:00100000:3.0:1789683524.894309:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789683524.894320:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815570688:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683524.894555:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815570688:12345-0@lo:502:mount.lustre.0 Request processed in 236us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683524.894563:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789683524.895267:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570688:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683524.895582:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789683524.895643:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789683524.895705:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789683524.899051:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789683524.902039:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789683524.903368:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789683524.903426:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789683524.903458:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789683524.903511:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789683524.903548:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789683524.903580:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789683524.903642:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789683524.903712:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789683524.904620:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789683524.904714:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789683524.904764:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789683524.904790:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789683524.904842:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789683524.904874:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789683524.904902:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789683524.904944:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789683524.905000:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789683524.905032:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789683524.905079:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789683524.907111:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789683524.907188:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789683524.907266:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789683524.907312:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789683524.907455:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789683524.907516:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789683524.907552:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789683524.907588:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789683524.907636:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789683524.907967:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789683524.908009:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789683524.908087:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789683524.908263:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789683524.908972:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789683524.909368:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789683524.909400:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789683524.909446:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570816:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683524.909513:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.909554:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789683524.911201:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815570816 00000100:00100000:1.0:1789683524.911212:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815570816 00000100:00100000:1.0:1789683524.911261:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789683524.911269:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815570816:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683524.916699:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815570816:12345-0@lo:502:mount.lustre.0 Request processed in 5423us (7178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683524.916713:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789683524.916976:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815570816:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683524.917246:0:15091:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789683524.917273:0:15091:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1789683524.920889:0:15114:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1789683524.920906:0:15114:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8dbe6bfd19c0) 00000020:00000080:0.0:1789683524.920928:0:15114:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1789683524.921013:0:15114:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe75e5a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789683524.921017:0:15114:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dbe75e5a000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1789683524.921020:0:15114:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe75e5a000 3 00010000:00080000:0.0:1789683524.921053:0:15114:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbe46fcc800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.160@tcp at head 00010000:00010000:0.0:1789683524.932197:0:15114:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1789683524.932405:0:15114:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1789683524.932443:0:15114:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789683524.932456:0:15114:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x59bee33f93ffb0f 00000100:00080000:0.0:1789683524.932467:0:15114:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789683524.932480:0:15114:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8dbe46fcc800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:0.0:1789683524.932517:0:15114:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe7c1ace00 x1876618815570944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789683524.932557:0:15114:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789683524.932589:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683524.932594:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789683524.932597:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789683524.932600:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789683524.932648:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815571072:0@lo:400:kworker.0 00000100:00100000:1.0:1789683524.932990:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876618815570944:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789683524.934560:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.934645:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815571072 00000100:00100000:0.0:1789683524.934653:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815571072 00000100:00100000:0.0:1789683524.934715:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683524.934726:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815571072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683524.934807:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815571072:12345-0@lo:400:kworker.0 Request processed in 84us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683524.934816:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683524.934841:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683524.934882:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815570944 00000100:00100000:0.0:1789683524.934886:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815570944 00000100:00100000:0.0:1789683524.934903:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683524.934908:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876618815570944:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789683524.934929:0:14409:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 458 last 0 00000020:00000080:0.0:1789683524.934981:0:14409:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x59bee33f93ffb16 00000004:00100000:0.0:1789683524.934997:0:14409:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789683524.935028:0:14409:0:(import.c:65:import_set_state_nolock()) ffff8dbd45456800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683524.935073:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876618815570944:12345-0@lo:38:llog_process_th.0 Request processed in 163us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683524.935088:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789683524.935131:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dbe7c1ace00 x1876618815570944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683524.935155:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789683524.935163:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789683524.935171:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789683524.935176:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789683524.935178:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe46fcc800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789683524.935184:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876618815570944:0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789683524.935221:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8dbe7c1ac700 x1876618815571072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683524.935231:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815571072:0@lo:400:kworker.0 00000040:00080000:2.0:1789683524.938705:0:15114:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1789683524.938838:0:15091:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789683524.938872:0:15091:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789683524.938936:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7e00/0x59bee33f93ffafa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffb01 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683524.938950:0:15091:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7e00/0x59bee33f93ffafa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffb01 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789683524.939010:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789683524.939012:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789683524.939014:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683524.939015:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683524.939016:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683524.939017:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683524.939019:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789683524.939022:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683524.939023:0:15091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789683524.939028:0:15091:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1789683524.939030:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789683524.939031:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789683524.939033:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789683524.939034:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789683524.939035:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789683524.939037:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789683524.939038:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789683524.939039:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789683524.939040:0:15091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789683524.939067:0:15091:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789683524.939087:0:15091:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815571200:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789683524.939180:0:15091:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683524.939229:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815571200 00000100:00100000:1.0:1789683524.939233:0:15091:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe60946300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683524.939238:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815571200 00000100:00100000:3.0:1789683524.939373:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789683524.939383:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+16:15091:x1876618815571200:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789683524.939411:0:14404:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789683524.939493:0:14404:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789683525.009804:0:14404:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789683525.009824:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789683525.009880:0:14425:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789683525.009886:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789683525.009907:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683525.009926:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffa83 expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683525.009935:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683525.009973:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93ffa83 expref: 16 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683525.009992:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93ffa83 expref: 16 pid: 14403 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683525.010006:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876618815571328:0@lo:104: 00000100:00100000:2.0:1789683525.010064:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683525.010129:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe46ef1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789683525.010211:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815571328 00000100:00100000:1.0:1789683525.010219:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815571328 00000100:00100000:1.0:1789683525.010267:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683525.010286:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:267f495e-c971-4db4-b237-3907c961127d+3:14425:x1876618815571328:12345-0@lo:104: 00010000:00010000:1.0:1789683525.010300:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683525.010365:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683525.010371:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:267f495e-c971-4db4-b237-3907c961127d+3:14425:x1876618815571328:12345-0@lo:104: Request processed in 97us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683525.010378:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1789683525.010399:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683525.010407:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010414:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909600 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:3.0:1789683525.010418:0:14398:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010438:0:14398:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789683525.010444:0:14398:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683525.010450:0:14398:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789683525.010476:0:14398:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010483:0:14398:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789683525.010508:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010515:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7b909600/0x59bee33f93ffa83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffa8a expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010532:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683525.010534:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683525.010535:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683525.010546:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789683525.010555:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815571456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683525.010584:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683525.010615:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815571456 00000100:00100000:3.0:1789683525.010619:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815571456 00010000:00010000:3.0:1789683525.010636:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffa83 expref: 17 pid: 14403 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683525.010654:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683525.010660:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267f495e-c971-4db4-b237-3907c961127d+17:3305:x1876618815571456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683525.010719:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683525.010725:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffa83 expref: 17 pid: 14403 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010735:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93ffa83 expref: 17 pid: 14403 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010749:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010756:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789683525.010766:0:14396:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001101860s 00010000:00010000:3.0:1789683525.010770:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010776:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010782:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010788:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010793:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683525.010809:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010817:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010832:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683525.010844:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683525.010872:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267f495e-c971-4db4-b237-3907c961127d+17:3305:x1876618815571456:12345-0@lo:103:ldlm_bl.0 Request processed in 211us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683525.010878:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683525.010907:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815571456:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789683525.011044:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7c40f000/0x59bee33f93ffa8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93ffa83 expref: 16 pid: 14403 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683525.011054:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876618815571328:0@lo:104: 00010000:00010000:2.0:1789683525.011066:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683525.011075:0:14425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683525.011081:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683525.011087:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7b908a00/0x59bee33f93ffb1d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683525.038627:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+15:15091:x1876618815571200:12345-0@lo:253:mount.lustre.0 Request processed in 99235us (99436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683525.038643:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789683525.038796:0:15091:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15091:1876618815571200:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789683525.038814:0:15091:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789683525.038817:0:15091:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789683525.038819:0:15091:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789683525.038821:0:15091:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683525.038822:0:15091:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683525.038823:0:15091:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683525.038836:0:15091:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683525.038837:0:15091:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683525.038839:0:15091:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683525.038841:0:15091:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789683525.038857:0:15091:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789683525.046928:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789683525.047083:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789683525.047255:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789683525.047403:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789683525.047541:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789683525.047776:0:15091:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789683525.048970:0:15091:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789683525.096043:0:15091:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789683525.096052:0:15091:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789683525.096085:0:15091:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683525.096165:0:15091:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683525.096178:0:15091:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789683525.096206:0:15091:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1789683525.215796:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683526.242351:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789683527.012921:0:14406:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789683527.012928:0:14406:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dbe529e1800 from 7 10000000:01000000:0.0:1789683527.012933:0:14406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789683527.012978:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683527.012990:0:14406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683527.013001:0:14406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683527.013026:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815571584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683527.013110:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683527.013166:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9600 going to sleep for 11 seconds 00000100:00100000:1.0:1789683527.013906:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815571584 00000100:00100000:1.0:1789683527.013917:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815571584 00000100:00100000:1.0:1789683527.013976:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789683527.013986:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+15:14406:x1876618815571584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683527.014002:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683527.014020:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffb24 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683527.014047:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffb24 expref: 16 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683527.014058:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffb24 expref: 16 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683527.014067:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7600, rc 0) 00000100:00100000:1.0:1789683527.014147:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+16:14406:x1876618815571584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683527.014154:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789683527.014443:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815571584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683527.014462:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683527.014472:0:14406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683527.014537:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815571712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789683527.014579:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683527.014619:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe768bbe40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683527.014662:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815571712 00000100:00100000:0.0:1789683527.014668:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815571712 00000100:00100000:0.0:1789683527.014725:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789683527.014733:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+16:14406:x1876618815571712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789683527.014750:0:14404:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683527.014767:0:14404:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683527.014770:0:14404:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1789683527.014863:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+16:14406:x1876618815571712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 130us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683527.014870:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789683527.014901:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815571712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789683527.014959:0:14406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789683527.014967:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683527.014975:0:14406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683527.267541:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683528.296136:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683529.313986:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789683530.209950:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683530.209957:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789683530.209960:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789683530.209962:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789683530.210024:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815571840:0@lo:400:kworker.0 00000100:00100000:0.0:1789683530.210077:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815571968:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.210091:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683530.217507:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815572096:0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.217915:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815571840 00000100:00100000:2.0:1789683530.217925:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815571840 00000100:00100000:2.0:1789683530.217981:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789683530.217991:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+16:3305:x1876618815571840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683530.218064:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+16:3305:x1876618815571840:12345-0@lo:400:kworker.0 Request processed in 74us (7972us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683530.218087:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789683530.218111:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683530.218146:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815571968 00000100:00100000:0.0:1789683530.218150:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815571968 00000100:00100000:0.0:1789683530.218178:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683530.218185:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815571968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683530.218221:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815571968:12345-0@lo:400:kworker.0 Request processed in 37us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683530.218236:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789683530.218273:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe799c9500 x1876618815571968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683530.218286:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815571968:0@lo:400:kworker.0 00000100:00100000:0.0:1789683530.218336:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815571840:0@lo:400:kworker.0 00000100:00100000:0.0:1789683530.222140:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683530.227252:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815572096 00000100:00100000:3.0:1789683530.227268:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815572096 00000100:00100000:3.0:1789683530.227344:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683530.227356:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815572096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683530.227449:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815572096:12345-0@lo:400:kworker.0 Request processed in 96us (5318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683530.227457:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789683530.227799:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe799c8a80 x1876618815572096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789683530.227954:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683530.235336:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815572096:0@lo:400:kworker.0 00010000:00010000:1.0:1789683530.341865:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683531.364604:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789683532.279004:0:15459:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789683532.393757:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789683532.836783:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789683533.412641:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683534.432934:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683535.199805:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683520/real 1789683520] req@ffff8dbe799c9c00 x1876618815567872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683535 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683535.199837:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dbe799c9c00 x1876618815567872/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683535 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683535.199848:0:3301:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789683520/real 1789683520] req@ffff8dbe799ca300 x1876618815568000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683535 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683535.199859:0:3301:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8dbe799ca300 x1876618815568000/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789683535 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789683535.199879:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9fd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683535.199906:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789683535.199910:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815567872:0@lo:8:kworker.0 00000100:00080000:3.0:1789683535.199917:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe59193800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683535.199922:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789683535.199925:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815568000:0@lo:8:kworker.0 00000100:00080000:1.0:1789683535.200102:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683535.200106:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789683535.200109:0:37:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9fd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683535.200114:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:1.0:1789683535.200120:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789683535.200131:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8dbe4e9fd800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1789683535.200150:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe76136a00 x1876618815572352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683535.200171:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683535.200175:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683535.200176:0:37:0:(import.c:65:import_set_state_nolock()) ffff8dbe59193800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683535.200179:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 454 00000100:00080000:1.0:1789683535.200182:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789683535.200186:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dbe59193800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1789683535.200197:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe76136d80 x1876618815572480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789683535.200377:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815572608:0@lo:400:kworker.0 00000100:00100000:0.0:1789683535.200435:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683535.200493:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683535.200500:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815572224:0@lo:400:kworker.0 00000100:00100000:0.0:1789683535.200526:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683535.200557:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815572736:0@lo:400:kworker.0 00000100:00100000:0.0:1789683535.200580:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683535.200610:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815572224 00000100:00100000:0.0:1789683535.200617:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815572224 00000100:00100000:0.0:1789683535.200653:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789683535.200661:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+16:3305:x1876618815572224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683535.200723:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+16:3305:x1876618815572224:12345-0@lo:400:kworker.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683535.200730:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789683535.200758:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815572608 00000100:00100000:0.0:1789683535.200761:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815572608 00000100:00100000:0.0:1789683535.201057:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815572736 00000100:00100000:0.0:1789683535.201071:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815572736 00000100:00080000:2.0:1789683535.201125:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789683535.201972:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815572352:0@lo:8:kworker.0 00000100:00100000:3.0:1789683535.202026:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683535.202074:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815572480:0@lo:8:kworker.0 00000100:00100000:3.0:1789683535.202096:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683535.203058:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815572352 00000100:00100000:2.0:1789683535.203077:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815572352 00000100:00100000:2.0:1789683535.203101:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815572480 00000100:00100000:2.0:1789683535.203103:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815572480 00000100:00100000:2.0:1789683535.203117:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683535.203124:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876618815572352:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1789683535.203153:0:15093:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 468 last 0 00000020:00000080:2.0:1789683535.203189:0:15093:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93ffb32 00002000:00100000:2.0:1789683535.203203:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8dbe6fe18800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789683535.203207:0:15093:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789683535.203210:0:15093:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789683535.204381:0:15093:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789683535.204411:0:15093:0:(import.c:65:import_set_state_nolock()) ffff8dbe6fe1b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683535.204499:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876618815572352:12345-0@lo:8:kworker.0 Request processed in 1373us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683535.204507:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683535.204530:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789683535.204536:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876618815572480:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1789683535.204550:0:15093:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1789683535.204577:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876618815572480:12345-0@lo:8:kworker.0 Request processed in 40us (2480us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789683535.204597:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789683535.205592:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe76136a00 x1876618815572352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683535.205613:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683535.205622:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789683535.205632:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789683535.205637:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789683535.205640:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe4e9fd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789683535.205659:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789683535.205664:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815572352:0@lo:8:kworker.0 00000100:00080000:3.0:1789683535.205700:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe59193800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683535.205705:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789683535.205707:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815572480:0@lo:8:kworker.0 00000004:00080000:3.0:1789683535.205735:0:14431:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789683535.205989:0:14431:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 468837315155ns, next at 0ns, rc = 0 00000004:00080000:2.0:1789683535.206553:0:14432:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789683535.206575:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1876618815572992:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789683535.206629:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683535.206652:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52b12180 going to sleep for 11 seconds 00000100:00100000:2.0:1789683535.206698:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789683535.206707:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815572864:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683535.206731:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683535.206766:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815572864 00000100:00100000:2.0:1789683535.206772:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815572864 00000100:00100000:3.0:1789683535.207017:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815572992 00000100:00100000:3.0:1789683535.207021:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815572992 00000100:00100000:3.0:1789683535.207079:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789683535.207088:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14432:x1876618815572992:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789683535.207586:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789683535.207593:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876618815572864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683535.207616:0:15096:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683535.207666:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876618815572864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683535.207689:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789683535.207727:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe799c8000 x1876618815572864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683551 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683535.207748:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815572864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683535.208509:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683535.208528:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815572608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683535.208579:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876618815572608:12345-0@lo:400:kworker.0 Request processed in 55us (8144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683535.208585:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789683535.208599:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789683535.208604:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815572736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789683535.208631:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815572736:12345-0@lo:400:kworker.0 Request processed in 27us (8050us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683535.208636:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789683535.211571:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe76134000 x1876618815572736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789683535.211590:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815572736:0@lo:400:kworker.0 00000100:00080000:3.0:1789683535.211870:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789683535.212256:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815572224:0@lo:400:kworker.0 00010000:00080000:0.0:1789683535.212273:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe76134700 x1876618815572608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683551 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789683535.212284:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876618815572608:0@lo:400:kworker.0 00002000:00080000:3.0:1789683535.212370:0:15095:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789683535.212377:0:15095:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1789683535.212381:0:15095:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1789683535.227584:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683535.227595:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227612:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789683535.227616:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683535.227630:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227649:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227664:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227707:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227727:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683535.227754:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683535.227760:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227768:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8000 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683535.227773:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227782:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227799:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227829:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.227852:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.227854:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.227857:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683535.228513:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683535.228519:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.228529:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789683535.228532:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683535.228536:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.228545:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.228553:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.228560:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.228581:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683535.228715:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.228722:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.228732:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.228737:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.228747:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.228765:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.228772:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb40 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.228801:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.228803:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.228805:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683535.229027:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683535.229038:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.229047:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789683535.229050:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683535.229054:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.230422:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.230442:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.230450:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.230479:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683535.230522:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683535.230530:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.230538:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683535.230542:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.230551:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.230570:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.230584:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091a6b45d/0x59bee33f93ffb47 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.230607:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.230609:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.230612:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683535.231090:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683535.231097:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231107:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789683535.231111:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683535.231116:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231127:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231141:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231148:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231165:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683535.231716:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683535.231722:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231731:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789683535.231734:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683535.231738:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231747:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231755:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231761:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.231790:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789683535.232102:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683535.232109:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232118:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683535.232123:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232132:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232155:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232171:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3ba1169/0x59bee33f93ffb4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232188:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683535.232191:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232204:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9e00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683535.232207:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232215:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232224:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232231:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e55e3024/0x59bee33f93ffb55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.232242:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.232244:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.232246:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683535.236360:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683535.236372:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.236390:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789683535.236395:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683535.236402:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.236417:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.236428:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.236437:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.236467:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683535.236535:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683535.236544:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.236555:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683535.236560:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.236571:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.236600:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.236608:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000794aaf3f/0x59bee33f93ffb5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.236632:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.236635:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.236638:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.236966:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683535.237214:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683535.237221:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237231:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789683535.237240:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683535.237245:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237256:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237263:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237271:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237289:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683535.237299:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683535.237304:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237311:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683535.237316:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237323:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237334:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237353:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000729b28c8/0x59bee33f93ffb63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.237373:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.237375:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.237378:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683535.241326:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683535.241340:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241357:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789683535.241361:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683535.241368:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241383:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241393:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241400:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241423:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683535.241435:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683535.241446:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241454:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8000 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683535.241458:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241467:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241484:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241491:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b017095/0x59bee33f93ffb6a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.241509:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.241510:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.241512:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683535.242010:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683535.242016:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242025:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=468s v=(0 0) 00010000:00010000:3.0:1789683535.242027:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683535.242031:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242052:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242060:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242080:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242094:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683535.242103:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683535.242107:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242114:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683535.242118:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242126:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242136:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242143:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000892b7f65/0x59bee33f93ffb71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.242162:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.242164:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.242165:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.248726:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.248740:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.248762:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.248767:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.248773:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.248788:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.248798:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.248806:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.249233:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789683535.252350:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.252362:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.252379:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.252384:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.252390:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.252404:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.252425:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.252433:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.254478:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683535.254494:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.254507:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.254519:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.254530:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.254548:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.254556:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a986e478/0x59bee33f93ffb78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.257256:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.257271:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.257284:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.257289:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.257301:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.257321:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.257328:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.257337:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.257340:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683535.259570:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789683535.259586:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffb7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.260285:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.260528:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.260536:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.260550:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.260555:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.260561:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.260575:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.260585:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.260602:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.260620:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789683535.261039:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.261044:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.261052:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.261055:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.261059:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.261079:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.261087:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.261093:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.261109:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789683535.261167:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789683535.261176:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261185:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.261189:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261199:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261216:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261224:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009a086408/0x59bee33f93ffb86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261242:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.261245:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261252:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908e00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.261256:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261276:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261287:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261295:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffb8d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.261309:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.261311:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.261313:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.261506:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.263193:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.263203:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.263225:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.263230:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.263236:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.266610:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.266632:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.266641:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.266668:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683535.267788:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683535.267798:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.267810:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683535.267816:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.267826:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.267847:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.267854:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e84b6f72/0x59bee33f93ffb94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.267882:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.267884:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.267886:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.268764:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.268774:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.268787:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.268791:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.268798:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.268810:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.268831:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.268838:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.268864:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683535.269113:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.269120:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.269129:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909c00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.269133:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.269141:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.269155:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.269174:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a3f9ec4/0x59bee33f93ffb9b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.269191:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.269193:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.269194:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.271082:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.271092:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.271107:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.271112:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.271118:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.271130:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.271150:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.271522:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.271595:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789683535.272225:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.272233:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.272301:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.272306:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.272311:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.272324:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.272333:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.272340:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272606:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683535.272615:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272622:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683535.272627:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272635:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272650:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272657:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcc8b18b/0x59bee33f93ffba2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272691:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683535.272695:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272701:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683535.272711:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272719:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272729:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.272737:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.272739:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.272742:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683535.272792:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789683535.272796:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7f63690/0x59bee33f93ffba9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.273041:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.273977:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.273985:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.274003:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.274007:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.274012:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.274024:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.274032:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.274039:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.274059:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683535.274824:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.274834:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.274845:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908000 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.274850:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.274859:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.274876:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.274884:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0cfbbad/0x59bee33f93ffbb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.274907:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.274910:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.274919:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.275232:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.275240:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.275261:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.275266:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.275271:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.275282:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.275302:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.275310:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.275338:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683535.275525:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.275531:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.275539:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909e00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.275543:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.275550:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.275560:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.275568:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a636e55e/0x59bee33f93ffbb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.275583:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.275584:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.275586:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.276045:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.276051:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.276427:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.276434:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.276440:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.276520:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.276530:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.276538:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.276574:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683535.276723:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.276729:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.276738:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.276742:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.276774:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.276789:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.276797:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a132a0e/0x59bee33f93ffbbe lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.276817:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.276819:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.276822:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.277044:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.277049:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.277058:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.277072:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.277077:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.277086:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.277094:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.277100:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.277121:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683535.277156:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.277162:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.277170:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.277174:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.277181:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.277192:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.277212:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7ffe9f2/0x59bee33f93ffbc5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.277230:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.277233:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.277236:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789683535.278895:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789683535.278905:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.278919:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=468s v=(0 0) 00010000:00010000:2.0:1789683535.278930:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683535.278935:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.278947:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.278956:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.278964:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.278981:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789683535.280404:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789683535.280414:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.280426:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908e00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683535.280430:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.280440:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.280458:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.280464:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e23b6c00/0x59bee33f93ffbcc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.280483:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.280485:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.280486:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789683535.282390:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1789683535.287178:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789683535.287191:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.287210:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789683535.287215:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683535.287222:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.287236:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.287248:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.287256:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.287285:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683535.287430:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683535.287438:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.287458:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683535.287463:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.287474:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.287494:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.287502:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e94fc575/0x59bee33f93ffbd3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683535.287543:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.287546:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683535.287549:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683535.287937:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789683535.287944:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.287953:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789683535.287957:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683535.287961:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.287982:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.287991:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.287997:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.289028:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789683535.289640:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789683535.289649:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.289664:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789683535.289668:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683535.289701:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.289714:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.289724:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.289743:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295824:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683535.295839:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295853:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683535.295857:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295869:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295890:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295918:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001353204c/0x59bee33f93ffbda lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295942:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683535.295945:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295952:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683535.295955:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295963:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295975:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683535.295982:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683535.295984:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683535.295986:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.296770:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789683535.296781:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed2ceec9/0x59bee33f93ffbe1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789683535.301731:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789683535.301744:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.301762:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789683535.301766:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683535.301772:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.301786:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.301795:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.301802:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.301841:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683535.302259:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683535.302267:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302276:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683535.302281:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302290:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302309:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302315:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089b60035/0x59bee33f93ffbe8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302334:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.302336:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.302337:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683535.302574:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789683535.302580:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.302589:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789683535.302592:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683535.302597:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.302607:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.302615:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.302622:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.302644:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789683535.302843:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683535.302848:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302869:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683535.302872:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302880:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302891:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302899:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e0ab5ca/0x59bee33f93ffbef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.302914:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.302916:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.302917:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789683535.303555:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789683535.303562:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.303572:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=468s v=(0 0) 00010000:00010000:1.0:1789683535.303582:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683535.303586:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.303917:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683535.303970:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.303978:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.303985:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683535.304036:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1789683535.304262:0:15095:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1789683535.304347:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14432:x1876618815572992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 97258us (97714us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683535.304360:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683535.307279:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1876618815572992:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1789683535.307301:0:14432:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1789683535.307352:0:14432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76137b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1876618815573120:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1789683535.307426:0:14432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683535.307472:0:14432:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d3780 going to sleep for 11 seconds 00000100:00100000:2.0:1789683535.308309:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815573120 00000100:00100000:2.0:1789683535.308319:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815573120 00000100:00100000:2.0:1789683535.308370:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683535.308380:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14432:x1876618815573120:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789683535.308425:0:15094:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:3.0:1789683535.309852:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789683535.309864:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.309877:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683535.309882:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.309894:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.309923:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.309931:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc7410ce/0x59bee33f93ffbf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683535.309952:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.309954:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683535.309956:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683535.322212:0:14432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76137b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14432:1876618815573120:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789683535.322231:0:14432:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:3.0:1789683535.322796:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76137800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14432:x1876618815573120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13293us (14245us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789683535.322809:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000001:00080000:0.0:1789683535.443774:0:6700:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789683535.443801:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789683535.458438:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683536.481587:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683537.512276:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683538.531787:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683539.569770:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789683539.977128:0:15810:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789683539.977132:0:15810:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1789683539.977247:0:15810:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8dbe46fc8800 00000020:01000004:2.0:1789683539.977263:0:15810:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789683539.977276:0:15810:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1789683539.977289:0:15810:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8dbe48c60000) 00000020:00000080:2.0:1789683539.977303:0:15810:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789683540.032893:0:15810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1789683540.042910:0:15810:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789683540.046372:0:15810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789683540.049423:0:15810:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789683540.049858:0:15810:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789683540.051872:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 449: rc = 0 00100000:10000000:2.0:1789683540.052122:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 449: rc = 0 00100000:10000000:2.0:1789683540.053345:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 449: rc = 0 00100000:10000000:2.0:1789683540.054993:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 585: rc = 0 00100000:10000000:3.0:1789683540.064576:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 585: rc = 0 00100000:10000000:3.0:1789683540.065141:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 585: rc = 0 00100000:10000000:3.0:1789683540.065379:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 585: rc = 0 00100000:10000000:3.0:1789683540.065638:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 585: rc = 0 00100000:10000000:3.0:1789683540.066085:0:15810:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 585: rc = 0 00000020:00000080:3.0:1789683540.066661:0:15810:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789683540.067280:0:15810:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789683540.067294:0:15810:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x59bee33f93ffc04 00000020:01000004:3.0:1789683540.067302:0:15810:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1789683540.067323:0:15810:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.160@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789683540.067326:0:15810:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.160@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789683540.067334:0:15810:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789683540.067356:0:15810:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1789683540.067360:0:15810:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.160@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789683540.078411:0:15810:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.160@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789683540.078462:0:15810:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.160@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789683540.078467:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789683540.078469:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683540.078470:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683540.078471:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683540.078473:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683540.078474:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683540.078476:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683540.078478:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683540.078479:0:15810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683540.078483:0:15810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789683540.078485:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789683540.078486:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683540.078488:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683540.078489:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683540.078490:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683540.078491:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683540.078492:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683540.078493:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683540.078494:0:15810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789683540.078535:0:15810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789683540.078557:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573248:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789683540.078628:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.078786:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683540.079258:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815573248 00000100:00100000:0.0:1789683540.079267:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815573248 00000100:00100000:0.0:1789683540.079374:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789683540.079386:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+16:15810:x1876618815573248:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789683540.079435:0:14404:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789683540.079439:0:14404:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789683540.079443:0:14404:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789683540.118149:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+16:15810:x1876618815573248:12345-0@lo:253:mount.lustre.0 Request processed in 38758us (39513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.118177:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789683540.118886:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573248:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789683540.118902:0:15810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789683540.118906:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789683540.118908:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789683540.118909:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789683540.118910:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789683540.118911:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789683540.118913:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789683540.118914:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789683540.118916:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789683540.118917:0:15810:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789683540.118948:0:15810:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8dbe46fc8800 from lustre-OST0001 10000000:01000000:3.0:1789683540.118976:0:15810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789683540.118979:0:15810:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789683540.118999:0:15810:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8dbe48c64d40 local copy 00010000:00010000:3.0:1789683540.119009:0:15810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683540.119239:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683540.119287:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.119329:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683540.119458:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815573376 00000100:00100000:0.0:1789683540.119465:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815573376 00000100:00100000:0.0:1789683540.119512:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789683540.119520:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+16:15810:x1876618815573376:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683540.119710:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+16:15810:x1876618815573376:12345-0@lo:501:mount.lustre.0 Request processed in 190us (421us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789683540.119717:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789683540.120888:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573376:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789683540.120911:0:15810:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.160@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789683540.121266:0:15810:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.160@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789683540.121275:0:15810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.121288:0:15810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e800/0x59bee33f93ff9aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ff9b1 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683540.121315:0:15810:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8dbe46fc8800 10000000:01000000:3.0:1789683540.121320:0:15810:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789683540.121326:0:15810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789683540.121329:0:15810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789683540.121334:0:15810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789683540.121337:0:15810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789683540.121369:0:15810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93ffc0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.121377:0:15810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93ffc0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.121395:0:15810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93ffc0b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683540.121413:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683540.121465:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.121508:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683540.123337:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815573504 00000100:00100000:1.0:1789683540.123350:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815573504 00000100:00100000:1.0:1789683540.123414:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789683540.123424:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+16:15810:x1876618815573504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789683540.123440:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683540.123456:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe76fc6a00/0x59bee33f93ffc12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffc0b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683540.123481:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe76fc6a00/0x59bee33f93ffc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffc0b expref: 17 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683540.123492:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe76fc6a00/0x59bee33f93ffc12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffc0b expref: 17 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683540.123501:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6a00, rc 0) 00000100:00100000:1.0:1789683540.123580:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815573504:12345-0@lo:101:mount.lustre.0 Request processed in 157us (2114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.123587:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789683540.124313:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683540.124332:0:15810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93ffc0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc12 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.124342:0:15810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93ffc0b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffc12 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683540.126352:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1789683540.131377:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683540.131600:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1789683540.131628:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1789683540.131645:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1789683540.131668:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1789683540.131735:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1789683540.131842:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1789683540.131892:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1789683540.131899:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1789683540.131976:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683540.132049:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.132136:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683540.134544:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815573632 00000100:00100000:2.0:1789683540.134560:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815573632 00000100:00100000:2.0:1789683540.134628:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789683540.134639:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815573632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789683540.135662:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815573632:12345-0@lo:501:mount.lustre.0 Request processed in 1022us (3609us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683540.135689:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789683540.139992:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683540.140083:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573760:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683540.140158:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683540.140335:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815573760 00000100:00100000:3.0:1789683540.140336:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683540.140343:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815573760 00000100:00100000:0.0:1789683540.140400:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789683540.140418:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815573760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683540.141366:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815573760:12345-0@lo:503:mount.lustre.0 Request processed in 945us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683540.141376:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789683540.141886:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573760:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789683540.143474:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789683540.143569:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683540.143648:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.143710:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683540.144784:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815573888 00000100:00100000:1.0:1789683540.144796:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815573888 00000100:00100000:1.0:1789683540.144847:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789683540.144856:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815573888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683540.145168:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815573888:12345-0@lo:502:mount.lustre.0 Request processed in 312us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.145176:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789683540.147103:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815573888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683540.147368:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1789683540.147419:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1789683540.147444:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1789683540.147497:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1789683540.147526:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1789683540.148224:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1789683540.148280:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1789683540.148313:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1789683540.148356:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1789683540.148402:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683540.148490:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.148536:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789683540.148899:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815574016 00000100:00100000:2.0:1789683540.149055:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815574016 00000100:00100000:2.0:1789683540.149118:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789683540.149128:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815574016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683540.149352:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815574016:12345-0@lo:502:mount.lustre.0 Request processed in 225us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683540.149359:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789683540.152197:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574016:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789683540.152373:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1789683540.152388:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1789683540.154157:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789683540.154167:0:15811:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789683540.154181:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789683540.154183:0:15811:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789683540.154188:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789683540.154202:0:15811:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8dbd44530000) 00000020:00000080:3.0:1789683540.154224:0:15811:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789683540.154229:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789683540.154306:0:15811:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe46fc8800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789683540.154314:0:15811:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789683540.154324:0:15811:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x59bee33f93ffc20 00010000:00010000:2.0:1789683540.171378:0:15811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789683540.176414:0:15811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1789683540.193368:0:15811:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1789683540.198104:0:15811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1789683540.198128:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683540.198134:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683540.198136:0:15811:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789683540.198139:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683540.198143:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683540.198145:0:15811:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789683540.198148:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789683540.198151:0:15811:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789683540.198153:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683540.198155:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683540.198157:0:15811:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789683540.198159:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789683540.198161:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683540.198162:0:15811:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789683540.198165:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789683540.198230:0:15811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789683540.198233:0:15811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789683540.198235:0:15811:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789683540.198238:0:15811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789683540.199582:0:15810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789683540.199614:0:15810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789683540.199638:0:15810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93ffc0b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc12 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.199650:0:15810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8000/0x59bee33f93ffc0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc12 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683540.199659:0:15810:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe46fc8800 from 1 10000000:01000000:3.0:1789683540.199662:0:15810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789683540.199716:0:15810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.199724:0:15810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.199735:0:15810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683540.199758:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683540.199825:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.199870:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789683540.200339:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815574144 00000100:00100000:2.0:1789683540.200347:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815574144 00000100:00100000:2.0:1789683540.200406:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789683540.200416:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+17:15810:x1876618815574144:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789683540.200430:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683540.200443:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffc27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683540.200466:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffc27 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683540.200476:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffc27 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683540.200484:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909a00, rc 0) 00000100:00100000:2.0:1789683540.200527:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574144:12345-0@lo:101:mount.lustre.0 Request processed in 113us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683540.200545:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789683540.202164:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683540.202188:0:15810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.202201:0:15810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789683540.202765:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789683540.203075:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789683540.203302:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789683540.203347:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789683540.203413:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789683540.203420:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789683540.203478:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683540.203538:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.203587:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683540.204873:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815574272 00000100:00100000:1.0:1789683540.204884:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815574272 00000100:00100000:1.0:1789683540.204949:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789683540.204960:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574272:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789683540.205241:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574272:12345-0@lo:501:mount.lustre.0 Request processed in 283us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.205248:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789683540.205380:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b91b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574272:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683540.205429:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574400:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683540.205474:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683540.205514:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7bf34cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683540.205563:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815574400 00000100:00100000:1.0:1789683540.205568:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815574400 00000100:00100000:1.0:1789683540.205629:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789683540.205637:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574400:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789683540.205798:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574400:12345-0@lo:503:mount.lustre.0 Request processed in 162us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.205812:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789683540.207410:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574400:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789683540.212410:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789683540.212501:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574528:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789683540.212592:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683540.212731:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5305d900 going to sleep for 11 seconds 00000100:00100000:0.0:1789683540.219236:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815574528 00000100:00100000:0.0:1789683540.219252:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815574528 00000100:00100000:0.0:1789683540.219309:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789683540.219315:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683540.219528:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76c8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574528:12345-0@lo:502:mount.lustre.0 Request processed in 213us (6937us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683540.219544:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789683540.219608:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574528:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683540.220322:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789683540.220472:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789683540.220550:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789683540.220590:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789683540.220627:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789683540.220710:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789683540.221104:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789683540.221145:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789683540.221189:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683540.221258:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683540.221295:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe7bf34300 going to sleep for 11 seconds 00000100:00100000:3.0:1789683540.221418:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815574656 00000100:00100000:3.0:1789683540.221426:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815574656 00000100:00100000:3.0:1789683540.221472:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789683540.221480:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5314d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574656:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789683540.221699:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5314d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574656:12345-0@lo:502:mount.lustre.0 Request processed in 218us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683540.221707:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789683540.222138:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683540.222248:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789683540.222261:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789683540.225968:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683540.225991:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683540.225994:0:15815:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789683540.226003:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe46fc8800 00000020:00000080:0.0:1789683540.226005:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683540.226012:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683540.226015:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683540.226017:0:15815:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789683540.226019:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683540.226022:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683540.226033:0:15815:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789683540.226038:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8dbe46fc8800 00000020:00000080:0.0:1789683540.226040:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683540.226111:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683540.226115:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683540.226117:0:15815:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789683540.226119:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789683540.226122:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683540.226123:0:15815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789683540.226127:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8dbe46fc8800 00000020:00000080:0.0:1789683540.226129:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789683540.226166:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789683540.226170:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789683540.226171:0:15815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789683540.226174:0:15815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789683540.226415:0:15810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789683540.226440:0:15810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789683540.226461:0:15810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.226487:0:15810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789683540.226531:0:15810:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789683540.226535:0:15810:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8dbe46fc8800 10000000:01000000:3.0:1789683540.226537:0:15810:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8dbe46fc8800 10000000:01000000:3.0:1789683540.226542:0:15810:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789683540.226547:0:15810:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8dbe46fc8800 from 1 10000000:01000000:3.0:1789683540.226550:0:15810:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789683540.226585:0:15810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93ffc35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.226594:0:15810:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93ffc35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.226604:0:15810:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93ffc35 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683540.226629:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b919c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574784:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789683540.226715:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.226826:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683540.226965:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815574784 00000100:00100000:0.0:1789683540.226973:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815574784 00000100:00100000:0.0:1789683540.227197:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789683540.227207:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5314dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815574784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789683540.227220:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683540.227233:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40ea00/0x59bee33f93ffc3c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffc35 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.227266:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40ea00/0x59bee33f93ffc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffc35 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.227276:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40ea00/0x59bee33f93ffc3c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffc35 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.227286:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40ea00, rc 0) 00000100:00100000:0.0:1789683540.227327:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5314dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815574784:12345-0@lo:101:mount.lustre.0 Request processed in 122us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683540.227334:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789683540.229152:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b919c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574784:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789683540.229178:0:15810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93ffc35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc3c expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683540.229190:0:15810:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93ffc35 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffc3c expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789683540.230800:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789683540.233530:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789683540.233869:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789683540.233916:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789683540.233954:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789683540.235668:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789683540.236973:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789683540.237058:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789683540.237094:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789683540.237124:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789683540.237167:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789683540.237199:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789683540.237229:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789683540.237297:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789683540.237334:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789683540.237362:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789683540.237406:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789683540.237434:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789683540.237461:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789683540.237500:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789683540.237545:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789683540.237572:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789683540.237613:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789683540.237646:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789683540.239103:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789683540.239201:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789683540.239235:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789683540.239265:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789683540.239304:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789683540.239334:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789683540.239363:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789683540.239406:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789683540.239453:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789683540.239484:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789683540.239513:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1789683540.244203:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1789683540.244286:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1789683540.244335:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1789683540.244368:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1789683540.244459:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1789683540.244467:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1789683540.246175:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b919c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683540.246245:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.246291:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683540.246854:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815574912 00000100:00100000:0.0:1789683540.246862:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815574912 00000100:00100000:0.0:1789683540.246907:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789683540.246917:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe5314c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815574912:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789683540.249110:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe5314c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815574912:12345-0@lo:501:mount.lustre.0 Request processed in 2189us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683540.249122:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789683540.249730:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b919c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815574912:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789683540.249851:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b919c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815575040:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789683540.249901:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.249937:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe4970b300 going to sleep for 11 seconds 00000100:00100000:0.0:1789683540.250188:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815575040 00000100:00100000:0.0:1789683540.250196:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815575040 00000100:00100000:0.0:1789683540.250237:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789683540.250245:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815575040:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789683540.250404:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aed450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815575040:12345-0@lo:503:mount.lustre.0 Request processed in 159us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683540.250412:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789683540.250453:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b919c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815575040:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789683540.254470:0:15810:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789683540.260272:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815575168:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683540.260355:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683540.260407:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815575168 00000100:00100000:0.0:1789683540.260414:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815575168 00000100:00100000:0.0:1789683540.260462:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789683540.260471:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815575168:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683540.260710:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aec050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815575168:12345-0@lo:502:mount.lustre.0 Request processed in 239us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683540.260718:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789683540.261382:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe510fa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683540.261408:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815575168:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789683540.263815:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789683540.263907:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789683540.263945:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789683540.265376:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789683540.265478:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789683540.265553:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789683540.265593:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789683540.265626:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789683540.265695:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789683540.265733:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789683540.265892:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789683540.265945:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789683540.266061:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789683540.266106:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789683540.266159:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789683540.266194:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789683540.266225:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789683540.266278:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789683540.266326:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789683540.266360:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789683540.266431:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789683540.266468:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789683540.266503:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789683540.267217:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789683540.267272:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789683540.267306:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789683540.267366:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789683540.267402:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789683540.267432:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789683540.267478:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789683540.267510:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789683540.269895:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789683540.271125:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789683540.271277:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789683540.271316:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789683540.271364:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789683540.271411:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789683540.271445:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789683540.271495:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789683540.271529:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789683540.276084:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815575296:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789683540.276170:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683540.278203:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe521cca80 going to sleep for 11 seconds 00000100:00100000:1.0:1789683540.281103:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815575296 00000100:00100000:1.0:1789683540.281120:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815575296 00000100:00100000:1.0:1789683540.281202:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683540.281212:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815575296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789683540.281523:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815575296:12345-0@lo:502:mount.lustre.0 Request processed in 311us (5351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.281531:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789683540.282776:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ac380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815575296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789683540.282897:0:15810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789683540.282914:0:15810:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789683540.288875:0:15820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789683540.288896:0:15820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8dbe7d6419c0) 00000020:00000080:1.0:1789683540.288919:0:15820:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789683540.289019:0:15820:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8dbe46fc8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789683540.289033:0:15820:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8dbe46fc8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789683540.289036:0:15820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8dbe46fc8800 3 00010000:00080000:1.0:1789683540.289070:0:15820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8dbe7bfb8000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.160@tcp at head 00010000:00010000:1.0:1789683540.290653:0:15820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1789683540.290879:0:15820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1789683540.290912:0:15820:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789683540.290925:0:15820:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x59bee33f93ffc4a 00000100:00080000:1.0:1789683540.290936:0:15820:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789683540.290945:0:15820:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8dbe7bfb8000 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1789683540.290985:0:15820:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe76134700 x1876618815575424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789683540.291012:0:15820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789683540.291082:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683540.291086:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683540.291089:0:38:0:(import.c:65:import_set_state_nolock()) ffff8dbe59193800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683540.291093:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 468 00000100:00080000:1.0:1789683540.291097:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789683540.291102:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dbe59193800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1789683540.291116:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe76134000 x1876618815575680/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683540.291167:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815575552:0@lo:400:kworker.0 00000100:00100000:1.0:1789683540.291229:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683540.291262:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789683540.291268:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815575808:0@lo:400:kworker.0 00000100:00100000:1.0:1789683540.291295:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683540.291324:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815575936:0@lo:400:kworker.0 00000100:00100000:1.0:1789683540.291346:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683540.291375:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815575552 00000100:00100000:1.0:1789683540.291382:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815575552 00000100:00100000:1.0:1789683540.291427:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683540.291437:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815575552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683540.291485:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76136680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815575552:12345-0@lo:400:kworker.0 Request processed in 50us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.291492:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683540.291523:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815575808 00000100:00100000:1.0:1789683540.291527:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815575808 00000100:00100000:1.0:1789683540.291549:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815575936 00000100:00100000:1.0:1789683540.291552:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815575936 00000100:00100000:1.0:1789683540.291569:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683540.291575:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815575808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683540.291607:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876618815575808:12345-0@lo:400:kworker.0 Request processed in 33us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.291613:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683540.291625:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789683540.291630:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815575936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683540.291660:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76136300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815575936:12345-0@lo:400:kworker.0 Request processed in 30us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.291666:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789683540.291737:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe76136a00 x1876618815575936/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683540.291749:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815575936:0@lo:400:kworker.0 00010000:00080000:1.0:1789683540.291777:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe76136d80 x1876618815575808/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683540.291786:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876618815575808:0@lo:400:kworker.0 00000100:00100000:1.0:1789683540.291795:0:3304:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789683540.291804:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815575552:0@lo:400:kworker.0 00000100:00100000:3.0:1789683540.295240:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876618815575424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789683540.295316:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.295362:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815575680:0@lo:8:kworker.0 00000100:00100000:3.0:1789683540.295385:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789683540.295423:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789683540.295429:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789683540.295477:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815575424 00000100:00100000:3.0:1789683540.295487:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815575424 00000100:00100000:3.0:1789683540.295523:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683540.295529:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1876618815575424:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789683540.295570:0:14410:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 473 last 0 00000020:00000080:3.0:1789683540.295604:0:14410:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x59bee33f93ffc51 00000004:00100000:3.0:1789683540.295627:0:14410:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789683540.295662:0:14410:0:(import.c:65:import_set_state_nolock()) ffff8dbd47778800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683540.295734:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876618815575424:12345-0@lo:38:llog_process_th.0 Request processed in 202us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683540.295753:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683540.295777:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815575680 00000100:00100000:3.0:1789683540.295780:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815575680 00000100:00100000:3.0:1789683540.295798:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683540.295802:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1876618815575680:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789683540.295835:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1876618815575680:12345-0@lo:8:kworker.0 Request processed in 32us (449us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789683540.295841:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789683540.297131:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8dbe76134700 x1876618815575424/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789683550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789683540.297147:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683540.297157:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789683540.297166:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789683540.297172:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789683540.297175:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bfb8000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789683540.297181:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876618815575424:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789683540.297194:0:3301:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789683540.297198:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe59193800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789683540.297201:0:3301:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789683540.297203:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815575680:0@lo:8:kworker.0 00000040:00080000:3.0:1789683540.298133:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789683540.298437:0:15810:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789683540.298464:0:15810:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789683540.298481:0:15810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93ffc35 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc3c expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.298492:0:15810:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea8600/0x59bee33f93ffc35 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc3c expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789683540.298572:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789683540.298574:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789683540.298576:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683540.298577:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683540.298578:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683540.298580:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683540.298581:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683540.298584:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683540.298585:0:15810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683540.298589:0:15810:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1789683540.298591:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789683540.298593:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789683540.298594:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789683540.298595:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789683540.298597:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789683540.298598:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789683540.298599:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789683540.298600:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789683540.298601:0:15810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789683540.298625:0:15810:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1789683540.298643:0:15810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815576064:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789683540.298738:0:15810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683540.298784:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815576064 00000100:00100000:0.0:1789683540.298790:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815576064 00000100:00100000:0.0:1789683540.298828:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789683540.298837:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+19:15810:x1876618815576064:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789683540.298862:0:14403:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789683540.298877:0:14403:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789683540.299421:0:15810:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe521ccb40 going to sleep for 11 seconds 20000000:01000000:1.0:1789683540.394692:0:14403:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789683540.394713:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789683540.394899:0:14425:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789683540.394904:0:14425:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789683540.394931:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683540.394950:0:14425:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffb24 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683540.394959:0:14425:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683540.395000:0:14425:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93ffb24 expref: 19 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683540.395015:0:14425:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93ffb24 expref: 19 pid: 14402 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683540.395039:0:14425:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876618815576192:0@lo:104: 00000100:00100000:2.0:1789683540.395103:0:14425:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683540.395159:0:14425:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe54ae9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789683540.395238:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815576192 00000100:00100000:1.0:1789683540.395245:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815576192 00000100:00100000:1.0:1789683540.395309:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683540.395318:0:14392:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:267f495e-c971-4db4-b237-3907c961127d+3:14425:x1876618815576192:12345-0@lo:104: 00010000:00010000:1.0:1789683540.395331:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683540.395384:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789683540.395390:0:14392:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:267f495e-c971-4db4-b237-3907c961127d+3:14425:x1876618815576192:12345-0@lo:104: Request processed in 74us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683540.395397:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789683540.395935:0:14425:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14425:1876618815576192:0@lo:104: 00010000:00010000:2.0:1789683540.395957:0:14425:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.396052:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683540.396058:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.396080:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f400 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:0.0:1789683540.396085:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.396092:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789683540.396099:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789683540.396105:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789683540.396180:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.396188:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789683540.396213:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.396221:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f400/0x59bee33f93ffb24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffb2b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.396238:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683540.396239:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683540.396241:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789683540.396286:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815576320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683540.396334:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683540.396950:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815576320 00000100:00100000:0.0:1789683540.396958:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815576320 00010000:00010000:0.0:1789683540.396984:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffb24 expref: 20 pid: 14402 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683540.397020:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683540.397046:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267f495e-c971-4db4-b237-3907c961127d+20:3303:x1876618815576320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683540.397058:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683540.397063:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffb24 expref: 20 pid: 14402 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397074:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93ffb24 expref: 20 pid: 14402 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397088:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe76fc7600/0x59bee33f93ffb2b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93ffb24 expref: 20 pid: 14402 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397102:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397110:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789683540.397125:0:14396:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002221078s 00010000:00010000:0.0:1789683540.397130:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397137:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397144:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397151:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397157:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683540.397167:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397175:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397191:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397201:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683540.397247:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267f495e-c971-4db4-b237-3907c961127d+19:3303:x1876618815576320:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683540.397254:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789683540.397287:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815576320:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683540.397307:0:14425:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397315:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683540.397322:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffc58 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683540.415226:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+18:15810:x1876618815576064:12345-0@lo:253:mount.lustre.0 Request processed in 116382us (116479us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683540.415241:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789683540.415366:0:15810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ae300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:267f495e-c971-4db4-b237-3907c961127d:15810:1876618815576064:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789683540.415382:0:15810:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789683540.415385:0:15810:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789683540.415405:0:15810:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789683540.415406:0:15810:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789683540.415407:0:15810:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789683540.415408:0:15810:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789683540.415410:0:15810:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789683540.415411:0:15810:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789683540.415413:0:15810:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789683540.415414:0:15810:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789683540.415431:0:15810:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789683540.443531:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789683540.443893:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789683540.444165:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789683540.444337:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789683540.444467:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789683540.444730:0:15810:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789683540.449154:0:15810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1789683540.449239:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683540.449258:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815576448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683540.449324:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683540.449456:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815576448 00000100:00100000:3.0:1789683540.449465:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815576448 00000100:00100000:3.0:1789683540.449518:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683540.449529:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815576448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683540.449565:0:15096:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683540.449613:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76136d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815576448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683540.449621:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789683540.449666:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815576448:0@lo:13:osp-pre-0-0.0 00002000:00080000:3.0:1789683540.538636:0:15810:0:(ofd_obd.c:547:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1789683540.538651:0:15810:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789683540.538735:0:15810:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789683540.538807:0:15810:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.160@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789683540.538830:0:15810:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789683540.538874:0:15810:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1789683540.580661:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683541.607850:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789683542.049613:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789683542.177588:0:14406:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789683542.177599:0:14406:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8dbe529e1800 from 8 10000000:01000000:0.0:1789683542.177606:0:14406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789683542.177698:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e200/0x59bee33f93ffc5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683542.177713:0:14406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e200/0x59bee33f93ffc5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683542.177941:0:14406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e200/0x59bee33f93ffc5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683542.177977:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815576576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789683542.178087:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683542.178211:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53eaa6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789683542.181918:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815576576 00000100:00100000:3.0:1789683542.181937:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815576576 00000100:00100000:3.0:1789683542.182061:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789683542.182074:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+18:14406:x1876618815576576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683542.182098:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683542.182126:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffc66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffc5f expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683542.182163:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffc66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffc5f expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683542.182177:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe54ea8e00/0x59bee33f93ffc66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffc5f expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683542.182206:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe54ea8e00, rc 0) 00000100:00100000:3.0:1789683542.182316:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:14406:x1876618815576576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (4227us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683542.182324:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789683542.182421:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815576576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789683542.182445:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e200/0x59bee33f93ffc5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc66 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683542.182456:0:14406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e200/0x59bee33f93ffc5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffc66 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683542.182550:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815576704:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789683542.182608:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683542.188292:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe485c8780 going to sleep for 11 seconds 00000100:00100000:0.0:1789683542.195600:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815576704 00000100:00100000:0.0:1789683542.195619:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815576704 00000100:00100000:0.0:1789683542.196169:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789683542.196182:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:14406:x1876618815576704:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789683542.196217:0:14402:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789683542.196236:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789683542.196239:0:14402:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789683542.196406:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:14406:x1876618815576704:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 227us (13797us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683542.196415:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789683542.196476:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815576704:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789683542.196559:0:14406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789683542.196571:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e200/0x59bee33f93ffc5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc66 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683542.196584:0:14406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40e200/0x59bee33f93ffc5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffc66 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683542.630036:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683543.653056:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683544.698477:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789683545.567818:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789683545.567825:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789683545.567829:0:36:0:(import.c:65:import_set_state_nolock()) ffff8dbe59193800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789683545.567848:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8dbe59193800 using connection 192.168.203.160@tcp/0@lo 00000100:00100000:1.0:1789683545.567870:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8dbe76135c00 x1876618815577088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789683545.567935:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815576832:0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568028:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683545.568076:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815577472:0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568107:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683545.568134:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789683545.568150:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815577344:0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568174:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683545.568205:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815576960:0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568229:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683545.568247:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683545.568252:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815577216:0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568270:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683545.568309:0:3301:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815577088:0@lo:8:kworker.0 00000100:00100000:1.0:1789683545.568335:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683545.568363:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815576832 00000100:00100000:1.0:1789683545.568371:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815576832 00000100:00100000:1.0:1789683545.568419:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789683545.568428:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:3305:x1876618815576832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568479:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aee850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:3305:x1876618815576832:12345-0@lo:400:kworker.0 Request processed in 51us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683545.568487:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789683545.568519:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815577472 00000100:00100000:1.0:1789683545.568523:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815577472 00000100:00100000:1.0:1789683545.568552:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815577344 00000100:00100000:1.0:1789683545.568555:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815577344 00000100:00100000:1.0:1789683545.568566:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815577216 00000100:00100000:1.0:1789683545.568568:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815577216 00000100:00100000:1.0:1789683545.568580:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683545.568585:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815577472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568616:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815577472:12345-0@lo:400:kworker.0 Request processed in 30us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683545.568622:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683545.568641:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789683545.568647:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815577344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568698:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76137100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876618815577344:12345-0@lo:400:kworker.0 Request processed in 51us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683545.568704:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789683545.568717:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683545.568724:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815577216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568755:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815577216:12345-0@lo:400:kworker.0 Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683545.568760:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683545.568780:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815576960 00000100:00100000:1.0:1789683545.568784:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815576960 00000100:00100000:1.0:1789683545.568806:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815577088 00000100:00100000:1.0:1789683545.568809:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815577088 00000100:00100000:1.0:1789683545.568819:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683545.568825:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815576960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.568852:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876618815576960:12345-0@lo:400:kworker.0 Request processed in 27us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683545.568857:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683545.568868:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789683545.568872:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876618815577088:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789683545.568896:0:15093:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:1.0:1789683545.568924:0:15093:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x59bee33f93ffc6d 00002000:00100000:1.0:1789683545.568937:0:15093:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8dbe7bfbc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789683545.568941:0:15093:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789683545.568944:0:15093:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789683545.569295:0:15093:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789683545.569317:0:15093:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bfbd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683545.569357:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876618815577088:12345-0@lo:8:kworker.0 Request processed in 483us (1020us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683545.569364:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1789683545.569394:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683545.569399:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789683545.569431:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76135c00 x1876618815577088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789683570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789683545.569448:0:3301:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789683545.569456:0:3301:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789683545.569461:0:3301:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789683545.569464:0:3301:0:(import.c:65:import_set_state_nolock()) ffff8dbe59193800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789683545.569487:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789683545.569493:0:3301:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876618815577088:0@lo:8:kworker.0 00000004:00080000:1.0:1789683545.569538:0:14434:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789683545.569553:0:14434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1876618815577728:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789683545.569580:0:14434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683545.569596:0:14434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe496d36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683545.569605:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683545.569612:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815577600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683545.569635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683545.569664:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815577600 00000100:00100000:1.0:1789683545.569669:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815577600 00000100:00100000:1.0:1789683545.569719:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789683545.569726:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815577600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789683545.569746:0:15096:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683545.569787:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815577600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683545.569793:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789683545.569810:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789683545.569825:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76135c00 x1876618815577600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789683561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683545.569840:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815577600:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1789683545.569863:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76134380 x1876618815577216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683545.569872:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815577216:0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.569882:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815576960:0@lo:400:kworker.0 00010000:00080000:1.0:1789683545.569906:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76137480 x1876618815577344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683545.569914:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76137480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876618815577344:0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.569923:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815576832:0@lo:400:kworker.0 00010000:00080000:1.0:1789683545.569933:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8dbe76135f80 x1876618815577472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789683561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789683545.569940:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815577472:0@lo:400:kworker.0 00000100:00100000:1.0:1789683545.569956:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815577728 00000100:00100000:1.0:1789683545.569959:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815577728 00000100:00100000:1.0:1789683545.569978:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789683545.569995:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14434:x1876618815577728:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789683545.576329:0:14433:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789683545.576769:0:14433:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 479208095466ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789683545.577892:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815577856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789683545.578107:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683545.578170:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815577856 00000100:00100000:1.0:1789683545.578178:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815577856 00000100:00100000:1.0:1789683545.578223:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683545.578239:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815577856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683545.578272:0:15096:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683545.578315:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815577856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683545.578322:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789683545.578368:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815577856:0@lo:13:osp-pre-0-0.0 00002000:00080000:1.0:1789683545.597603:0:15093:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789683545.597614:0:15093:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789683545.597618:0:15093:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:3.0:1789683545.623524:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.623537:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.623555:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.623559:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.623566:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.623586:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.623600:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.623608:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.623633:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683545.625290:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.625307:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625323:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.625328:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.625334:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625347:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625358:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625365:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625391:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789683545.625831:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.625838:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625846:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.625850:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.625854:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625863:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625879:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625885:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.625892:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789683545.626443:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.626450:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.626459:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.626462:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.626466:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.626475:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.626484:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.626492:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.626511:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789683545.626906:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.626912:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.626921:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.626924:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.626929:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.626938:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627216:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789683545.627225:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627234:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.627238:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627247:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627480:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627488:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000794aaf3f/0x59bee33f93ffc74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627508:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789683545.627512:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627526:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea8200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.627529:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627536:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627547:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627553:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a45b0fc/0x59bee33f93ffc7b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627565:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683545.627568:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627574:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9e00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.627577:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627585:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627594:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627607:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e55e3024/0x59bee33f93ffc82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627620:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683545.627624:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627630:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.627633:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627641:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627651:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627658:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3ba1169/0x59bee33f93ffc89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.627669:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.627688:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.627690:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683545.628371:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683545.630349:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.630360:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.630399:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789683545.631181:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683545.631191:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.631208:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.631213:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.631223:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.631243:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.631250:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091a6b45d/0x59bee33f93ffc90 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.631269:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.631271:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.631272:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683545.631455:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.631462:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.631474:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.631484:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.631490:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.631502:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.631510:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.631517:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.631531:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683545.631997:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.632004:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632013:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.632017:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.632020:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632030:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632038:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632050:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632067:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789683545.632429:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.632436:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632445:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.632449:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.632453:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632463:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632471:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632479:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632487:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789683545.632883:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.632889:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632904:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.632907:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.632911:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632920:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632927:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632934:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.632943:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789683545.633336:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.633342:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633350:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.633353:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.633357:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633367:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633385:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633392:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633400:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789683545.633802:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.633808:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633817:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.633820:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.633824:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633833:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633841:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633849:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.633868:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1789683545.634259:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.634266:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634275:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.634278:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.634282:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634293:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634302:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634310:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634318:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00010000:3.0:1789683545.634667:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.634700:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634709:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.634718:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.634722:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634732:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634739:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634746:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.634754:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1789683545.635231:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1789683545.635241:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635250:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c140800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.635255:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635265:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635289:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635298:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0fe9267/0x59bee33f93ffc97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635319:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789683545.635323:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635331:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c141a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.635334:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635343:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635352:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635360:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000507f0d0a/0x59bee33f93ffc9e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635371:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789683545.635375:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635388:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c141000 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.635391:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635400:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635411:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635419:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003115ea0e/0x59bee33f93ffca5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635432:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789683545.635437:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635443:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c140600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.635447:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635455:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635465:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635478:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000642bbbf2/0x59bee33f93ffcac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635494:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789683545.635498:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635504:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c140400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.635507:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635514:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635537:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635546:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edeaadc2/0x59bee33f93ffcb3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635560:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789683545.635564:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635571:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c141400 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.635580:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635588:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635600:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635608:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0ce52e1/0x59bee33f93ffcba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635620:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683545.635624:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635631:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c140e00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.635634:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635642:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635652:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635660:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007630bdd9/0x59bee33f93ffcc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635696:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683545.635699:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635706:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c141e00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.635709:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635717:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635728:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635735:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000798ff429/0x59bee33f93ffcc8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.635746:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.635748:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.635750:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683545.636357:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.636365:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.636378:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.636382:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.636387:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.636399:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.636408:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.636422:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.636446:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683545.636890:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.636895:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.636904:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.636908:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.636913:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.636923:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.636931:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.636939:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.637152:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683545.637159:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.637168:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c140200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.637177:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.637188:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.637202:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.637211:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097b876c6/0x59bee33f93ffccf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.637229:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.637231:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.637233:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683545.637304:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683545.637747:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.637752:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.637767:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.637770:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.637774:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.637784:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.637791:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.637798:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640227:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789683545.640241:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640256:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c141600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.640261:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640273:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640294:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640311:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea93e76e/0x59bee33f93ffcd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640335:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789683545.640339:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640346:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c140a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683545.640348:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640357:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640366:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.640374:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.640375:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.640377:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683545.643135:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683545.643193:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789683545.643206:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d2b6858/0x59bee33f93ffcdd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683545.643884:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.643892:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.643906:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.643910:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.643917:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.644120:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.644133:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.644141:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.644319:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683545.644793:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.644800:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.644811:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.644815:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.644820:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.644831:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.644838:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.644857:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.644866:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789683545.645486:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683545.645493:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645502:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c140000 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.645507:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645516:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645542:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645549:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1cbf676/0x59bee33f93ffce4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645572:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683545.645575:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645581:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c141200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.645584:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645591:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645599:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645606:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b1703a3f/0x59bee33f93ffceb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.645617:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683545.645618:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683545.645623:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683545.646270:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.646279:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646291:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.646295:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.646300:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646310:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646319:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646327:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646346:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683545.646750:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.646755:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646770:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.646773:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.646777:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646788:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646795:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646802:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.646811:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789683545.647166:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683545.647173:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647181:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c141800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.647186:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647194:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647209:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647216:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3ad595a/0x59bee33f93ffcf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647235:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683545.647239:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647245:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c140c00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.647248:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647255:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647272:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647279:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d70b8a4/0x59bee33f93ffcf9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.647292:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683545.647294:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683545.647296:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789683545.650596:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.650609:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.650625:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.650630:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.650637:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.650652:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683545.651239:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683545.651897:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.651905:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.651923:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789683545.652450:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.652458:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.652469:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.652473:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.652479:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.652492:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.652500:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.652507:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.652544:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789683545.652959:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.652965:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.652974:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.652977:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.652982:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653003:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653012:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653020:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653029:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789683545.653396:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.653402:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653412:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.653420:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.653425:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653436:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653445:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653453:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653461:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1789683545.653852:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.653858:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653868:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.653871:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.653876:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653886:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653894:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653908:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.653917:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1789683545.654303:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.654309:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654318:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.654322:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.654326:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654336:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654344:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654353:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654362:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:3.0:1789683545.654756:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789683545.654762:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654777:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=479s v=(0 0) 00010000:00010000:3.0:1789683545.654780:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683545.654784:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654792:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654800:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654807:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683545.654816:0:15093:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00002000:00080000:3.0:1789683545.654978:0:15093:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00010000:00010000:2.0:1789683545.655110:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789683545.655118:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655127:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c141c00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.655132:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655142:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655159:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655168:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e28950ca/0x59bee33f93ffd00 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655202:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789683545.655206:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655214:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.655217:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655226:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655237:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655246:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018c80615/0x59bee33f93ffd07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655258:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789683545.655262:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655270:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c96c00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.655273:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655292:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655303:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655310:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc792b7c/0x59bee33f93ffd0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655323:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1789683545.655327:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655334:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97c00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.655337:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655345:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655354:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655362:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000949bf2b/0x59bee33f93ffd15 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655384:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789683545.655387:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655394:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c96800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.655398:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655407:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655416:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655423:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffd1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655434:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683545.655438:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655444:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.655448:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655466:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655476:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655484:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e6026a9/0x59bee33f93ffd23 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655497:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683545.655500:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655507:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97000 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683545.655510:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655518:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655526:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655533:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a00539a6/0x59bee33f93ffd2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683545.655555:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683545.655557:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683545.655560:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789683545.656231:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1789683545.658908:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789683545.659381:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14434:x1876618815577728:12345-0@lo:5:osp-pre-1-0.0 Request processed in 89392us (89795us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683545.659392:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683545.659443:0:14434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1876618815577728:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789683545.659457:0:14434:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1789683545.659500:0:14434:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b919500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1876618815577984:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789683545.659532:0:14434:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683545.659574:0:14434:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe476e9780 going to sleep for 11 seconds 00000100:00100000:3.0:1789683545.659599:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815577984 00000100:00100000:3.0:1789683545.659606:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815577984 00000100:00100000:3.0:1789683545.659650:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789683545.659659:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14434:x1876618815577984:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789683545.659914:0:15094:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:3.0:1789683545.679826:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14434:x1876618815577984:12345-0@lo:5:osp-pre-1-0.0 Request processed in 20159us (20284us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789683545.679842:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789683545.680087:0:14434:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b919500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14434:1876618815577984:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789683545.680106:0:14434:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:3.0:1789683545.691287:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1789683545.695816:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683546.721576:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789683547.574203:0:16167:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg360-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789683547.744844:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683548.771162:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683549.690075:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683549.690150:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802996864 00000100:00100000:0.0:1789683549.690172:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802996864 00000100:00100000:0.0:1789683549.690226:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:0.0:1789683549.690235:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2351:x1876618802996864:12345-192.168.203.60@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789683549.690262:0:14403:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from e3ec037e-101a-4c9b-8daf-a9c299fb8628@192.168.203.60@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:0.0:1789683549.690289:0:14403:0:(genops.c:1384:class_connect()) connect: client e3ec037e-101a-4c9b-8daf-a9c299fb8628, cookie 0x59bee33f93ffd31 00000100:00080000:0.0:1789683549.690428:0:14403:0:(import.c:65:import_set_state_nolock()) ffff8dbd46bf5000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789683549.690499:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+5:2351:x1876618802996864:12345-192.168.203.60@tcp:250:mount.lustre.0 Request processed in 263us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683549.690506:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 74 00000100:00100000:1.0:1789683549.699327:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683549.699423:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802996992 00000100:00100000:3.0:1789683549.699434:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802996992 00000100:00100000:3.0:1789683549.699499:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1789683549.699509:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+5:13735:x1876618802996992:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789683549.699525:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683549.699542:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbd44c96400/0x59bee33f93ffd38 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f03a8 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683549.699569:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbd44c96400/0x59bee33f93ffd38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03a8 expref: 6 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683549.699579:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbd44c96400/0x59bee33f93ffd38 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03a8 expref: 6 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683549.699588:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c96400, rc 0) 00000100:00100000:3.0:1789683549.699655:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aedc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+6:13735:x1876618802996992:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 147us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683549.699714:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 75 00000100:00100000:3.0:1789683549.708426:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683549.709993:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802997120 00000100:00100000:1.0:1789683549.710008:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802997120 00000100:00100000:1.0:1789683549.710072:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:1.0:1789683549.710084:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+6:13735:x1876618802997120:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789683549.711779:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+6:13735:x1876618802997120:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 1688us (3354us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789683549.711793:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 76 00000100:00100000:3.0:1789683549.727556:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683549.727813:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802997248 00000100:00100000:0.0:1789683549.727823:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802997248 00000100:00100000:0.0:1789683549.727883:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1789683549.727892:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+6:13735:x1876618802997248:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789683549.727909:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683549.728040:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40fe00/0x59bee33f93ffd3f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f03af expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683549.728072:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40fe00/0x59bee33f93ffd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03af expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683549.728083:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40fe00/0x59bee33f93ffd3f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03af expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683549.728092:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40fe00, rc 0) 00000100:00100000:0.0:1789683549.728151:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aed850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+7:13735:x1876618802997248:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 260us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683549.728159:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 77 00000100:00100000:0.0:1789683549.729969:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683549.730093:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802997376 00000100:00100000:1.0:1789683549.730103:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802997376 00000100:00100000:1.0:1789683549.730150:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:1.0:1789683549.730160:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+7:13735:x1876618802997376:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789683549.730455:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aefc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+8:13735:x1876618802997376:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 296us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683549.730463:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 78 00000100:00100000:3.0:1789683549.732131:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683549.732228:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802997504 00000100:00100000:0.0:1789683549.732236:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802997504 00000100:00100000:0.0:1789683549.732289:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1789683549.732299:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+8:13735:x1876618802997504:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789683549.732827:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+8:13735:x1876618802997504:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 527us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683549.732835:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 79 00000100:00100000:0.0:1789683549.742132:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683549.742220:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802997632 00000100:00100000:3.0:1789683549.742230:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802997632 00000100:00100000:3.0:1789683549.742282:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:3.0:1789683549.742293:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+8:13753:x1876618802997632:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789683549.742899:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+8:13753:x1876618802997632:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 605us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683549.742908:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 80 00000100:00100000:3.0:1789683549.765995:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683549.766154:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802997760 00000100:00100000:2.0:1789683549.766165:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802997760 00000100:00100000:2.0:1789683549.766230:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:2.0:1789683549.766240:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+8:13753:x1876618802997760:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789683549.766513:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aeec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+8:13753:x1876618802997760:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 274us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683549.766522:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 81 00000100:00100000:1.0:1789683549.775572:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683549.775924:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802997888 00000100:00100000:0.0:1789683549.775936:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802997888 00000100:00100000:0.0:1789683549.776002:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:0.0:1789683549.776014:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+8:13735:x1876618802997888:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789683549.776033:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683549.776053:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40f400/0x59bee33f93ffd46 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f03d9 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683549.776082:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40f400/0x59bee33f93ffd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03d9 expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683549.776094:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7c40f400/0x59bee33f93ffd46 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03d9 expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683549.776104:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f400, rc 0) 00000100:00100000:0.0:1789683549.776206:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53aef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+9:13735:x1876618802997888:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 194us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683549.776213:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 82 00000100:00100000:1.0:1789683549.790288:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683549.790469:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802998016 00000100:00100000:3.0:1789683549.790614:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802998016 00000100:00100000:3.0:1789683549.790758:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:3.0:1789683549.790771:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe59f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+9:13735:x1876618802998016:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789683549.790800:0:14402:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789683549.790821:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789683549.790825:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789683549.790829:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789683549.790831:0:14402:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00010000:00010000:3.0:1789683549.792912:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683549.793470:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe59f20050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+9:13735:x1876618802998016:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 2696us (3184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683549.793496:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 83 00000100:00100000:1.0:1789683549.804307:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683549.804404:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802998144 00000100:00100000:2.0:1789683549.804414:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802998144 00000100:00100000:2.0:1789683549.804474:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:2.0:1789683549.804493:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe4a7b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+9:13735:x1876618802998144:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789683549.804510:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683549.804528:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f03e0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683549.804558:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03e0 expref: 10 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683549.804570:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03e0 expref: 10 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683549.804592:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909600, rc 0) 00000100:00100000:2.0:1789683549.804652:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe4a7b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13735:x1876618802998144:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 170us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683549.804659:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 84 00000100:00100000:0.0:1789683549.808655:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683549.811816:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802998272 00000100:00100000:1.0:1789683549.811835:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802998272 00000100:00100000:1.0:1789683549.811981:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:1.0:1789683549.812128:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13735:x1876618802998272:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789683549.812451:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13735:x1876618802998272:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 459us (3804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683549.812459:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 85 00000100:00100000:3.0:1789683549.818140:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683549.818586:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802998400 00000100:00100000:0.0:1789683549.818596:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802998400 00000100:00100000:0.0:1789683549.818738:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:0.0:1789683549.819495:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13735:x1876618802998400:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789683549.820177:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b12050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13735:x1876618802998400:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 691us (2043us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683549.820188:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 86 00000100:00100000:3.0:1789683549.832389:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683549.832716:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802998528 00000100:00100000:1.0:1789683549.832726:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802998528 00000100:00100000:1.0:1789683549.832783:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:1.0:1789683549.832794:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13758:x1876618802998528:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789683549.833446:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13758:x1876618802998528:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 650us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683549.833456:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 87 00000100:00100000:1.0:1789683549.841112:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683549.841274:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802998656 00000100:00100000:0.0:1789683549.841285:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802998656 00000100:00100000:0.0:1789683549.841345:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:0.0:1789683549.841356:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13758:x1876618802998656:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683549.841610:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13758:x1876618802998656:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 256us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683549.841619:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 88 00000100:00100000:3.0:1789683549.844431:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683549.844777:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802998784 00000100:00100000:1.0:1789683549.844799:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802998784 00000100:00100000:1.0:1789683549.844847:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1789683549.844856:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2351:x1876618802998784:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789683549.844884:0:14411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from f78a790a-0341-4215-9612-09be69631436@192.168.203.60@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:1.0:1789683549.844941:0:14411:0:(genops.c:1384:class_connect()) connect: client f78a790a-0341-4215-9612-09be69631436, cookie 0x59bee33f93ffd54 00000004:00100000:1.0:1789683549.844979:0:14411:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789683549.844989:0:14411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1789683549.913668:0:14411:0:(import.c:65:import_set_state_nolock()) ffff8dbe7bfbe000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683549.913774:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+6:2351:x1876618802998784:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 68917us (69350us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683549.913786:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:3.0:1789683549.918391:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683549.918451:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683549.918490:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802998912 00000100:00100000:1.0:1789683549.918500:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802998912 00000100:00100000:1.0:1789683549.918570:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802999040 00000100:00100000:1.0:1789683549.918574:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802999040 00000100:00100000:1.0:1789683549.918590:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1789683549.918598:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+7:0:x1876618802998912:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789683549.918653:0:14409:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789683549.918765:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+7:0:x1876618802998912:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 167us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683549.918772:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1789683549.918792:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1789683549.918798:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+6:13735:x1876618802999040:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789683549.918810:0:14409:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789683549.918832:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+6:13735:x1876618802999040:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 34us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683549.918849:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00080000:2.0:1789683549.919106:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683549.923172:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683549.924421:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802999168 00000100:00100000:3.0:1789683549.924433:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802999168 00000100:00100000:3.0:1789683549.924561:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:3.0:1789683549.924573:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+6:13735:x1876618802999168:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789683549.924882:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+6:13735:x1876618802999168:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 311us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683549.924889:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:0.0:1789683549.935756:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683549.935806:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683549.935832:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683549.935967:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802999552 00000100:00100000:2.0:1789683549.935977:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802999552 00000100:00100000:2.0:1789683549.936033:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1789683549.936044:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+6:13735:x1876618802999552:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789683549.936618:0:14412:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 503us 00000100:00100000:1.0:1789683549.939180:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802999296 00000100:00100000:1.0:1789683549.939196:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802999296 00000100:00100000:1.0:1789683549.939232:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802999424 00000100:00100000:1.0:1789683549.939236:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802999424 00000100:00100000:1.0:1789683549.939254:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1789683549.939263:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876618802999296:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789683549.939294:0:15095:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from f78a790a-0341-4215-9612-09be69631436@192.168.203.60@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:1.0:1789683549.939329:0:15095:0:(genops.c:1384:class_connect()) connect: client f78a790a-0341-4215-9612-09be69631436, cookie 0x59bee33f93ffd5b 00002000:00100000:1.0:1789683549.939360:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f78a790a-0341-4215-9612-09be69631436/ffff8dbe7bfba800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789683549.939386:0:15095:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789683549.939738:0:15095:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789683549.939771:0:15095:0:(import.c:65:import_set_state_nolock()) ffff8dbe53190000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683549.939845:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+6:2351:x1876618802999296:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 581us (4038us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683549.939853:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1789683549.939873:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1789683549.939878:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1876618802999424:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789683549.939894:0:15095:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from f78a790a-0341-4215-9612-09be69631436@192.168.203.60@tcp t0 exp 0000000000000000 cur 483 last 0 00000020:00000080:1.0:1789683549.939921:0:15095:0:(genops.c:1384:class_connect()) connect: client f78a790a-0341-4215-9612-09be69631436, cookie 0x59bee33f93ffd62 00002000:00100000:1.0:1789683549.939926:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f78a790a-0341-4215-9612-09be69631436/ffff8dbe53196000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789683549.939940:0:15095:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789683549.940088:0:15095:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789683549.940104:0:15095:0:(import.c:65:import_set_state_nolock()) ffff8dbe53192000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789683549.940137:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+6:2351:x1876618802999424:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 257us (4303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683549.940144:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000004:00200000:2.0:1789683549.967479:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789683549.967604:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+6:13735:x1876618802999552:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 31558us (31854us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683549.967614:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1789683550.150221:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683550.150380:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802999680 00000100:00100000:3.0:1789683550.150391:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802999680 00000100:00100000:3.0:1789683550.150451:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:3.0:1789683550.150461:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+6:13780:x1876618802999680:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:3.0:1789683550.150479:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683550.150509:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96600/0x59bee33f93ffd69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f040a expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683550.150578:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93ffd70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683550.150591:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93ffd70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683550.150605:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93ffd70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683550.150642:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789683550.150646:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683550.150709:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93ffd70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683550.150755:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96600/0x59bee33f93ffd69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f040a expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683550.150773:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93ffd70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f040a expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683550.150781:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5ada6000) 00010000:00010000:3.0:1789683550.150784:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683550.150787:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c97400, rc 0) 00000100:00100000:3.0:1789683550.150851:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+7:13780:x1876618802999680:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 391us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683550.150857:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1789683550.688323:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815578368:0@lo:400:kworker.0 00000100:00100000:1.0:1789683550.688400:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683550.688456:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815578880:0@lo:400:kworker.0 00000100:00100000:1.0:1789683550.688480:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683550.688790:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815578624:0@lo:400:kworker.0 00000100:00100000:0.0:1789683550.688821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683550.688844:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789683550.688850:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815578496:0@lo:400:kworker.0 00000100:00100000:0.0:1789683550.688870:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683550.688919:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815578368 00000100:00100000:0.0:1789683550.688935:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815578368 00000100:00100000:0.0:1789683550.688996:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815578496 00000100:00100000:0.0:1789683550.688999:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815578496 00000100:00100000:0.0:1789683550.689015:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683550.689023:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815578368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683550.689440:0:15093:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789683550.689450:0:15093:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789683550.689463:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789683550.689471:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683550.689479:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815578496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683550.689522:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815578496:12345-0@lo:400:kworker.0 Request processed in 45us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683550.689529:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789683550.689622:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815578496:0@lo:400:kworker.0 00000100:00100000:3.0:1789683550.689646:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815578880 00000100:00100000:3.0:1789683550.689650:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815578880 00000100:00100000:3.0:1789683550.689710:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815578624 00000100:00100000:3.0:1789683550.689714:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815578624 00000100:00100000:3.0:1789683550.689729:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789683550.689734:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815578880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683550.690019:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815578240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683550.690055:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683550.690077:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:267f495e-c971-4db4-b237-3907c961127d:3304:1876618815578112:0@lo:400:kworker.0 00000100:00100000:2.0:1789683550.690103:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683550.690128:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815578752:0@lo:400:kworker.0 00000100:00100000:2.0:1789683550.690149:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789683550.690171:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683550.690176:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683550.690178:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683550.690190:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815578240 00000100:00100000:2.0:1789683550.690200:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815578240 00000100:00100000:2.0:1789683550.691639:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683550.691647:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815578240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683550.691684:0:15097:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683550.691755:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1876618815578240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683550.691761:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789683550.691785:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815578112 00000100:00100000:2.0:1789683550.691791:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815578112 00000100:00100000:2.0:1789683550.691815:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1789683550.691820:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:3304:x1876618815578112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683550.691850:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:3304:x1876618815578112:12345-0@lo:400:kworker.0 Request processed in 30us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683550.691855:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789683550.692647:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815578368:12345-0@lo:400:kworker.0 Request processed in 3621us (4244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683550.692658:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789683550.692744:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815578368:0@lo:400:kworker.0 00000100:00100000:1.0:1789683550.692795:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789683550.692803:0:14409:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1789683550.692902:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815578752 00000100:00100000:1.0:1789683550.692907:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815578752 00000100:00100000:1.0:1789683550.692939:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789683550.692959:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683550.692974:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815578624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683550.693124:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815578240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683550.693136:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c526d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:267f495e-c971-4db4-b237-3907c961127d:3304:1876618815578112:0@lo:400:kworker.0 00000100:00080000:2.0:1789683550.693168:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683550.693185:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815579008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683550.693324:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683550.693359:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815579008 00000100:00100000:2.0:1789683550.693363:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815579008 00000100:00100000:2.0:1789683550.693387:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683550.693394:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876618815579008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683550.693407:0:15097:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683550.693442:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876618815579008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683550.693462:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789683550.693509:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876618815579008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789683550.694516:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815578624:12345-0@lo:400:kworker.0 Request processed in 1539us (5690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683550.694876:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789683550.694898:0:14409:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1789683550.694913:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789683550.694921:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815578752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683550.694941:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815578624:0@lo:400:kworker.0 00000100:00100000:1.0:1789683550.695890:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876618815578752:12345-0@lo:400:kworker.0 Request processed in 967us (5736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683550.695906:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789683550.696854:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876618815578752:0@lo:400:kworker.0 00000100:00100000:3.0:1789683550.697895:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815578880:12345-0@lo:400:kworker.0 Request processed in 8155us (9408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683550.697908:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789683550.698739:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815578880:0@lo:400:kworker.0 00000001:00100000:0.0:1789683550.772514:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f78a790a-0341-4215-9612-09be69631436 00000001:00100000:3.0:1789683550.794262:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f78a790a-0341-4215-9612-09be69631436 00000001:00080000:3.0:1789683550.794280:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:3.0:1789683550.815833:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683551.840585:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683552.288365:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683552.288525:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802999808 00000100:00100000:3.0:1789683552.288543:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802999808 00000040:00080000:2.0:1789683552.288577:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789683552.288783:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1789683552.288800:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+7:13832:x1876618802999808:12345-192.168.203.60@tcp:41:lfs.0 00000004:00000024:3.0:1789683552.288864:0:14411:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789683552.289075:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+7:13832:x1876618802999808:12345-192.168.203.60@tcp:41:lfs.0 Request processed in 278us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683552.289083:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00080000:0.0:1789683552.293074:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789683552.294173:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.294795:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618802999936 00000100:00100000:2.0:1789683552.294807:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618802999936 00000100:00100000:2.0:1789683552.294961:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1789683552.294974:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f78a790a-0341-4215-9612-09be69631436+5:13832:x1876618802999936:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:2.0:1789683552.295014:0:15097:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683552.295101:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f78a790a-0341-4215-9612-09be69631436+5:13832:x1876618802999936:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 130us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.295183:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1789683552.302125:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.302290:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803000064 00000100:00100000:2.0:1789683552.302299:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803000064 00000100:00080000:0.0:1789683552.303001:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789683552.303006:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683552.317657:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1789683552.317691:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f78a790a-0341-4215-9612-09be69631436+5:13832:x1876618803000064:12345-192.168.203.60@tcp:13:lfs.0 00002000:00000024:2.0:1789683552.317732:0:15097:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683552.317831:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f78a790a-0341-4215-9612-09be69631436+5:13832:x1876618803000064:12345-192.168.203.60@tcp:13:lfs.0 Request processed in 161us (15717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.317839:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1789683552.470603:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.470714:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803000192 00000100:00100000:2.0:1789683552.470724:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803000192 00000100:00100000:2.0:1789683552.470780:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:2.0:1789683552.470790:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+10:13862:x1876618803000192:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789683552.470823:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683552.470853:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7b909e00/0x59bee33f93ffd77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0411 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.470882:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7b909e00/0x59bee33f93ffd77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0411 expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.470904:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7b909e00/0x59bee33f93ffd77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0411 expref: 11 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.470913:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909e00, rc 0) 00000100:00100000:2.0:1789683552.471185:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13862:x1876618803000192:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 394us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.471193:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 90 00000100:00100000:1.0:1789683552.480877:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.481009:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803000320 00000100:00100000:2.0:1789683552.481020:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803000320 00000100:00100000:2.0:1789683552.481095:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:2.0:1789683552.481114:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13862:x1876618803000320:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789683552.481412:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13862:x1876618803000320:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 306us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.481421:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 91 00000100:00100000:0.0:1789683552.485211:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.485408:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803000448 00000100:00100000:2.0:1789683552.485419:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803000448 00000100:00100000:2.0:1789683552.485481:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:2.0:1789683552.485491:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13862:x1876618803000448:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789683552.485755:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13862:x1876618803000448:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 265us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.485769:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 92 00000100:00100000:3.0:1789683552.488203:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683552.488352:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803000576 00000100:00100000:1.0:1789683552.488362:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803000576 00000100:00100000:1.0:1789683552.488427:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1789683552.488437:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13870:x1876618803000576:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789683552.488740:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13870:x1876618803000576:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 303us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683552.488748:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 93 00000100:00100000:1.0:1789683552.509305:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683552.509422:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803000704 00000100:00100000:0.0:1789683552.509435:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803000704 00000100:00100000:0.0:1789683552.509531:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:0.0:1789683552.509543:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13870:x1876618803000704:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683552.510144:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13870:x1876618803000704:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 599us (845us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683552.510152:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 94 00000100:00100000:0.0:1789683552.519040:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.520562:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803000832 00000100:00100000:2.0:1789683552.520577:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803000832 00000100:00100000:2.0:1789683552.520705:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:2.0:1789683552.520718:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13862:x1876618803000832:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789683552.520737:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683552.520757:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe7b908000/0x59bee33f93ffd7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f043b expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.520787:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7b908000/0x59bee33f93ffd7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f043b expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.520800:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe7b908000/0x59bee33f93ffd7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f043b expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.520809:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908000, rc 0) 00000100:00100000:2.0:1789683552.521215:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13862:x1876618803000832:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 498us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.521222:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 95 00000100:00100000:3.0:1789683552.528613:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683552.529465:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803000960 00000100:00100000:0.0:1789683552.529475:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803000960 00000100:00100000:0.0:1789683552.529534:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:0.0:1789683552.529559:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13862:x1876618803000960:12345-192.168.203.60@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789683552.529582:0:14403:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789683552.529598:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789683552.529602:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789683552.529605:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789683552.529608:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1789683552.535500:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13862:x1876618803000960:12345-192.168.203.60@tcp:256:mount.lustre.0 Request processed in 5932us (6885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.535514:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 96 00000100:00100000:2.0:1789683552.545152:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683552.545314:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803001088 00000100:00100000:1.0:1789683552.545326:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803001088 00000100:00100000:1.0:1789683552.545384:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:1.0:1789683552.545395:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13862:x1876618803001088:12345-192.168.203.60@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789683552.545412:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683552.545431:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0442 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683552.545461:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0442 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683552.545472:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0442 expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683552.545481:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6000, rc 0) 00000100:00100000:1.0:1789683552.545551:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13862:x1876618803001088:12345-192.168.203.60@tcp:101:mount.lustre.0 Request processed in 157us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683552.545575:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 97 00000100:00100000:3.0:1789683552.547842:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.548048:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803001216 00000100:00100000:2.0:1789683552.548060:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803001216 00000100:00100000:2.0:1789683552.548123:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:2.0:1789683552.548134:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13862:x1876618803001216:12345-192.168.203.60@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789683552.548430:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13862:x1876618803001216:12345-192.168.203.60@tcp:501:mount.lustre.0 Request processed in 297us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.548438:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 98 00000100:00100000:0.0:1789683552.557897:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.560092:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803001344 00000100:00100000:2.0:1789683552.560107:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803001344 00000100:00100000:2.0:1789683552.560176:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:2.0:1789683552.560187:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13862:x1876618803001344:12345-192.168.203.60@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789683552.560444:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13862:x1876618803001344:12345-192.168.203.60@tcp:503:mount.lustre.0 Request processed in 258us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.560451:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 99 00000100:00100000:3.0:1789683552.567450:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683552.567910:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803001472 00000100:00100000:0.0:1789683552.567922:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803001472 00000100:00100000:0.0:1789683552.567988:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:0.0:1789683552.567998:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe53b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13875:x1876618803001472:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789683552.568273:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe53b12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13875:x1876618803001472:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 275us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683552.568281:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 100 00000100:00100000:3.0:1789683552.570231:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683552.570325:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803001600 00000100:00100000:1.0:1789683552.570334:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803001600 00000100:00100000:1.0:1789683552.570438:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:1.0:1789683552.570452:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13875:x1876618803001600:12345-192.168.203.60@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789683552.570754:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13875:x1876618803001600:12345-192.168.203.60@tcp:502:llog_process_th.0 Request processed in 305us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683552.570765:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 101 00000100:00100000:1.0:1789683552.580632:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.580780:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803001728 00000100:00100000:2.0:1789683552.580792:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803001728 00000100:00100000:2.0:1789683552.580836:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:2.0:1789683552.580844:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1876618803001728:12345-192.168.203.60@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789683552.580877:0:16284:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 95ed2437-53bb-4455-b4ea-65cc54f01d1f@192.168.203.60@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:2.0:1789683552.580928:0:16284:0:(genops.c:1384:class_connect()) connect: client 95ed2437-53bb-4455-b4ea-65cc54f01d1f, cookie 0x59bee33f93ffd8c 00000004:00100000:2.0:1789683552.580973:0:16284:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789683552.581102:0:16284:0:(import.c:65:import_set_state_nolock()) ffff8dbd46e0c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789683552.581181:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:2351:x1876618803001728:12345-192.168.203.60@tcp:38:mount.lustre.0 Request processed in 335us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.581189:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1789683552.583873:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683552.583925:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683552.584048:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803001984 00000100:00100000:1.0:1789683552.584058:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803001984 00000100:00100000:1.0:1789683552.584133:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803001856 00000100:00100000:1.0:1789683552.584137:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803001856 00000100:00100000:1.0:1789683552.584162:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1789683552.584172:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+7:13862:x1876618803001984:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789683552.584215:0:14409:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789683552.584283:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+7:13862:x1876618803001984:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 111us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683552.584291:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1789683552.584310:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1789683552.584317:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:0:x1876618803001856:12345-192.168.203.60@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789683552.584333:0:14409:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789683552.584358:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:0:x1876618803001856:12345-192.168.203.60@tcp:41:mount.lustre.0 Request processed in 42us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683552.584381:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00080000:0.0:1789683552.584568:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683552.598581:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.598736:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803002112 00000100:00100000:2.0:1789683552.598748:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803002112 00000100:00100000:2.0:1789683552.598805:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:2.0:1789683552.598815:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:13862:x1876618803002112:12345-192.168.203.60@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789683552.598939:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:13862:x1876618803002112:12345-192.168.203.60@tcp:40:mount.lustre.0 Request processed in 117us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.598947:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:1.0:1789683552.601209:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683552.601252:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683552.601286:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683552.601374:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803002240 00000100:00100000:3.0:1789683552.601384:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803002240 00000100:00100000:3.0:1789683552.601424:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803002368 00000100:00100000:3.0:1789683552.601427:0:15094:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803002368 00000100:00100000:3.0:1789683552.601445:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1789683552.601454:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876618803002240:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789683552.601498:0:15094:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 95ed2437-53bb-4455-b4ea-65cc54f01d1f@192.168.203.60@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1789683552.601543:0:15094:0:(genops.c:1384:class_connect()) connect: client 95ed2437-53bb-4455-b4ea-65cc54f01d1f, cookie 0x59bee33f93ffd93 00002000:00100000:3.0:1789683552.601557:0:15094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 95ed2437-53bb-4455-b4ea-65cc54f01d1f/ffff8dbd4777e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789683552.601568:0:15094:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789683552.601851:0:15094:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789683552.601881:0:15094:0:(import.c:65:import_set_state_nolock()) ffff8dbd4777d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683552.601954:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:2351:x1876618803002240:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 499us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683552.601963:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1789683552.601985:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1789683552.601989:0:15094:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2351:x1876618803002368:12345-192.168.203.60@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789683552.602006:0:15094:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 95ed2437-53bb-4455-b4ea-65cc54f01d1f@192.168.203.60@tcp t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:3.0:1789683552.602023:0:15094:0:(genops.c:1384:class_connect()) connect: client 95ed2437-53bb-4455-b4ea-65cc54f01d1f, cookie 0x59bee33f93ffd9a 00002000:00100000:3.0:1789683552.602029:0:15094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 95ed2437-53bb-4455-b4ea-65cc54f01d1f/ffff8dbd4777a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789683552.602035:0:15094:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789683552.602181:0:15094:0:(ofd_obd.c:393:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789683552.602197:0:15094:0:(import.c:65:import_set_state_nolock()) ffff8dbd4777c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789683552.602222:0:15094:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:2351:x1876618803002368:12345-192.168.203.60@tcp:8:mount.lustre.0 Request processed in 230us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683552.602229:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1789683552.604316:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803002496 00000100:00100000:0.0:1789683552.604330:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803002496 00000100:00100000:0.0:1789683552.604406:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1789683552.604420:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:13862:x1876618803002496:12345-192.168.203.60@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789683552.604496:0:14413:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789683552.604577:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:13862:x1876618803002496:12345-192.168.203.60@tcp:33:mount.lustre.0 Request processed in 159us (3377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683552.604585:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:3.0:1789683552.773309:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683552.774146:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803002624 00000100:00100000:2.0:1789683552.774158:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803002624 00000100:00100000:2.0:1789683552.774225:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:2.0:1789683552.774235:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:13896:x1876618803002624:12345-192.168.203.60@tcp:101:mkdir.0 00010000:00010000:2.0:1789683552.774256:0:16284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683552.774280:0:16284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93ffda1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f046c expref: -99 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.774352:0:16284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.774366:0:16284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.774381:0:16284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683552.774415:0:16284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683552.774419:0:16284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683552.774439:0:16284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.774471:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93ffda1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f046c expref: 8 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.774670:0:16284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f046c expref: 7 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683552.774741:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5ada6000) 00010000:00010000:2.0:1789683552.774744:0:16284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683552.774750:0:16284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909c00, rc 0) 00000100:00100000:2.0:1789683552.774819:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95ed2437-53bb-4455-b4ea-65cc54f01d1f+7:13896:x1876618803002624:12345-192.168.203.60@tcp:101:mkdir.0 Request processed in 584us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683552.774826:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:3.0:1789683552.864110:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683553.887820:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789683554.911783:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789683555.381751:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f78a790a-0341-4215-9612-09be69631436 00000001:00100000:3.0:1789683555.381769:0:5851:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 95ed2437-53bb-4455-b4ea-65cc54f01d1f 00000001:02000400:1.0:1789683555.511028:0:16372:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1789683555.807891:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815579136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789683555.807970:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683555.808192:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683555.808206:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815579264:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789683555.808237:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683555.808309:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815579136 00000100:00100000:0.0:1789683555.808318:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815579136 00000100:00100000:0.0:1789683555.808358:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815579264 00000100:00100000:0.0:1789683555.808361:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815579264 00000100:00100000:0.0:1789683555.808375:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683555.808382:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815579136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789683555.808415:0:15096:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1789683555.808833:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683555.808838:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789683555.810752:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815579392:0@lo:400:kworker.0 00000100:00100000:3.0:1789683555.810821:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683555.810882:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815579392 00000100:00100000:3.0:1789683555.810889:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815579392 00000100:00100000:1.0:1789683555.812488:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815579776:0@lo:400:kworker.0 00000100:00100000:1.0:1789683555.812549:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683555.812598:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815579520:0@lo:400:kworker.0 00000100:00100000:1.0:1789683555.812624:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683555.812644:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789683555.812651:0:3302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815579648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683555.812696:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683555.812731:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815579776 00000100:00100000:1.0:1789683555.812739:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815579776 00000100:00100000:1.0:1789683555.812785:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815579520 00000100:00100000:1.0:1789683555.812801:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815579520 00000100:00100000:1.0:1789683555.812822:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815579648 00000100:00100000:1.0:1789683555.812825:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815579648 00000100:00100000:1.0:1789683555.812847:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683555.812857:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815579776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683555.812922:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815579776:12345-0@lo:400:kworker.0 Request processed in 67us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683555.812929:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789683555.812946:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683555.812952:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815579520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683555.813000:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c526d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876618815579520:12345-0@lo:400:kworker.0 Request processed in 47us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683555.813007:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789683555.813022:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683555.813029:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815579648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683555.813055:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876618815579648:12345-0@lo:400:kworker.0 Request processed in 27us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683555.813061:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789683555.813294:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c527100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815579776:0@lo:400:kworker.0 00000100:00100000:1.0:1789683555.813321:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c524000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876618815579648:0@lo:400:kworker.0 00000100:00100000:1.0:1789683555.813329:0:3302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c527480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876618815579520:0@lo:400:kworker.0 00000100:00100000:3.0:1789683555.814028:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789683555.814040:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:3305:x1876618815579392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789683555.814108:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:3305:x1876618815579392:12345-0@lo:400:kworker.0 Request processed in 70us (3287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683555.814115:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1789683555.814782:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683555.814854:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815579392:0@lo:400:kworker.0 00000100:00100000:0.0:1789683555.817497:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815579136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9107us (9518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683555.817511:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789683555.817551:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683555.817566:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815579264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789683555.817603:0:15096:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789683555.817826:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815579264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 257us (9577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683555.817833:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789683555.817884:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c1af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815579264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683555.818479:0:3303:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789683555.818504:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815579136:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1789683555.867394:0:6700:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 95ed2437-53bb-4455-b4ea-65cc54f01d1f 00000001:00100000:3.0:1789683555.872095:0:7641:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 95ed2437-53bb-4455-b4ea-65cc54f01d1f 00010000:00010000:0.0:1789683555.937430:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683556.963296:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683557.985628:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683558.057053:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683558.057105:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683558.057148:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683558.057171:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683558.057189:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683558.057210:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683558.057235:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683558.057271:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803003264 00000100:00100000:1.0:1789683558.057284:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803003264 00000100:00100000:1.0:1789683558.057352:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803002880 00000100:00100000:1.0:1789683558.057355:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803002880 00000100:00100000:1.0:1789683558.057381:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1789683558.057409:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:2352:x1876618803003264:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683558.057518:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:2352:x1876618803003264:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 110us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683558.057526:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1789683558.057560:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1789683558.057569:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+6:2352:x1876618803002880:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683558.057600:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c527100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+6:2352:x1876618803002880:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683558.057607:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1789683558.057645:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803003008 00000100:00100000:1.0:1789683558.057649:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803003008 00000100:00100000:1.0:1789683558.057717:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803003520 00000100:00100000:1.0:1789683558.057720:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803003520 00000100:00100000:1.0:1789683558.057735:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803003136 00000100:00100000:1.0:1789683558.057737:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803003136 00000100:00100000:1.0:1789683558.057748:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803003392 00000100:00100000:1.0:1789683558.057751:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803003392 00000100:00100000:1.0:1789683558.057766:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1789683558.057772:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78a790a-0341-4215-9612-09be69631436+5:2352:x1876618803003008:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683558.057801:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78a790a-0341-4215-9612-09be69631436+5:2352:x1876618803003008:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 29us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683558.057809:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:1.0:1789683558.057821:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1789683558.057828:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:2352:x1876618803003520:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683558.057853:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c524000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:2352:x1876618803003520:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 26us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683558.057867:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1789683558.057879:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1789683558.057886:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78a790a-0341-4215-9612-09be69631436+5:2352:x1876618803003136:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683558.057923:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78a790a-0341-4215-9612-09be69631436+5:2352:x1876618803003136:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 38us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683558.057930:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:1.0:1789683558.057942:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:1.0:1789683558.057948:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:2352:x1876618803003392:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:1.0:1789683558.057971:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:2352:x1876618803003392:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 23us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683558.057976:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00080000:1.0:1789683558.058007:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789683558.058012:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683558.058015:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789683558.058859:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803002752 00000100:00100000:2.0:1789683558.058869:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803002752 00000100:00100000:2.0:1789683558.058944:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 103 00000100:00100000:2.0:1789683558.058956:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:2352:x1876618803002752:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683558.059028:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:2352:x1876618803002752:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 75us (1991us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683558.059035:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 103 00000020:00000080:2.0:1789683558.864278:0:16523:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc1aade80 20000000:00000080:2.0:1789683558.864295:0:16523:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8dbe47a6d400 uarg=0000000000000000 20000000:01000000:2.0:1789683558.864331:0:16523:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789683558.864337:0:16523:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789683558.864342:0:16523:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789683558.865120:0:16524:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1789683558.865276:0:16523:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789683558.871116:0:16523:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789683558.871234:0:16523:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.871255:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffa9f expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.871279:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffaec expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.871287:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffc27 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.871297:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03e0 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.871303:0:16523:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0442 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.871311:0:16523:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.871360:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0442 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.871375:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0442 expref: 12 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683558.871390:0:16523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815579904:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683558.872194:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03e0 expref: 12 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.872204:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03e0 expref: 12 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683558.872213:0:16523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815580032:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683558.872267:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93ffc27 expref: 18 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.872275:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93ffc27 expref: 18 pid: 14403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683558.872283:0:16523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815580160:0@lo:104: 00000100:00100000:0.0:1789683558.872319:0:16523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789683558.872390:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93ffaec expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.872398:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93ffaec expref: 18 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683558.872405:0:16523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815580288:0@lo:104: 00000100:00100000:0.0:1789683558.872424:0:16523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789683558.872830:0:16523:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x59bee33f93ffa9f expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.872838:0:16523:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x59bee33f93ffa9f expref: 18 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683558.872858:0:16523:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815580416:0@lo:104: 00000100:00100000:0.0:1789683558.872898:0:16523:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683558.872994:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815580160 00000100:00100000:2.0:1789683558.873010:0:14393:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815580160 00000100:00100000:0.0:1789683558.873083:0:16523:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe5305d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789683558.873116:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815580288 00000100:00100000:1.0:1789683558.873120:0:14392:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815580288 00000100:00100000:3.0:1789683558.873145:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815580416 00000100:00100000:1.0:1789683558.873146:0:14392:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789683558.873148:0:14393:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815580416 00000100:00100000:3.0:1789683558.873261:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683558.873271:0:14393:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:267f495e-c971-4db4-b237-3907c961127d+5:16523:x1876618815580160:12345-0@lo:104: 00010000:00010000:3.0:1789683558.873285:0:14393:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683558.873345:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789683558.873351:0:14393:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:267f495e-c971-4db4-b237-3907c961127d+5:16523:x1876618815580160:12345-0@lo:104: Request processed in 83us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683558.873358:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683558.873374:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683558.873380:0:14393:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:267f495e-c971-4db4-b237-3907c961127d+4:16523:x1876618815580288:12345-0@lo:104: 00010000:00010000:3.0:1789683558.873395:0:14393:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683558.874314:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789683558.874325:0:14393:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:267f495e-c971-4db4-b237-3907c961127d+4:16523:x1876618815580288:12345-0@lo:104: Request processed in 944us (1898us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683558.874333:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683558.874354:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683558.874363:0:14393:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbd44ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:267f495e-c971-4db4-b237-3907c961127d+3:16523:x1876618815580416:12345-0@lo:104: 00010000:00010000:3.0:1789683558.874374:0:14393:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683558.874741:0:16523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815580160:0@lo:104: 00000100:00100000:0.0:1789683558.874754:0:16523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815580288:0@lo:104: 00000100:00100000:0.0:1789683558.874761:0:16523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815580416:0@lo:104: 00010000:00010000:2.0:1789683558.877015:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789683558.877029:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877040:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe54ea9800 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683558.877043:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877052:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683558.877059:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683558.877064:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683558.877131:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877146:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683558.877292:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877300:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe54ea9800/0x59bee33f93ffc27 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffc2e expref: -99 pid: 15810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877318:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789683558.877321:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877326:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f600 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683558.877343:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877351:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683558.877358:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683558.877364:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683558.877379:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877385:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683558.877404:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877410:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7c40f600/0x59bee33f93ffaec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffaf3 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877419:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683558.877422:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877427:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908c00 already unused, calling callback (ffffffffc1b9ec20) 10000000:00010000:2.0:1789683558.877430:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877436:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789683558.877454:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789683558.877459:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789683558.877475:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877480:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789683558.877487:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877493:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.160@tcp lock: ffff8dbe7b908c00/0x59bee33f93ffa9f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x59bee33f93ffaa6 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.877509:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683558.877511:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683558.877513:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683558.877539:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815580800:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683558.877603:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683558.877649:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683558.877655:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815580672:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789683558.877696:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789683558.877857:0:14393:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1789683558.877867:0:14393:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbd44ee8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:267f495e-c971-4db4-b237-3907c961127d+3:16523:x1876618815580416:12345-0@lo:104: Request processed in 3505us (4967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683558.877877:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789683558.877950:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815580800 00000100:00100000:3.0:1789683558.877957:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815580800 00010000:00010000:3.0:1789683558.877982:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffa9f expref: 19 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683558.878086:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815580672 00000100:00100000:3.0:1789683558.878090:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815580672 00010000:00010000:3.0:1789683558.878102:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffaec expref: 20 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683558.878129:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683558.878136:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:267f495e-c971-4db4-b237-3907c961127d+20:3303:x1876618815580800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683558.878148:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683558.878344:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffa9f expref: 20 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683558.878357:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93ffa9f expref: 20 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683558.878370:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7c40ec00/0x59bee33f93ffaa6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93ffa9f expref: 20 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683558.878383:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683558.878424:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:267f495e-c971-4db4-b237-3907c961127d+19:3303:x1876618815580800:12345-0@lo:103:ldlm_bl.0 Request processed in 288us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683558.878432:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789683558.878445:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683558.878451:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:267f495e-c971-4db4-b237-3907c961127d+18:3303:x1876618815580672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789683558.878459:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683558.878463:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffaec expref: 18 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683558.878471:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93ffaec expref: 18 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683558.878481:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe76fc7000/0x59bee33f93ffaf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93ffaec expref: 18 pid: 14402 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683558.878489:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683558.878510:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:267f495e-c971-4db4-b237-3907c961127d+17:3303:x1876618815580672:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683558.878516:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789683558.878554:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815580672:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789683558.878572:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815580800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683558.878582:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815580544:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789683558.878618:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789683558.878635:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683558.878658:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815580544 00000100:00100000:0.0:1789683558.878664:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815580544 00010000:00010000:0.0:1789683558.878706:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffc27 expref: 17 pid: 14403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683558.878722:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683558.878727:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d65d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267f495e-c971-4db4-b237-3907c961127d+17:3305:x1876618815580544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789683558.878734:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683558.878738:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x59bee33f93ffc27 expref: 17 pid: 14403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.878746:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x59bee33f93ffc27 expref: 17 pid: 14403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.878756:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7b909a00/0x59bee33f93ffc2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x59bee33f93ffc27 expref: 17 pid: 14403 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683558.878765:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683558.878792:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d65d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:267f495e-c971-4db4-b237-3907c961127d+16:3305:x1876618815580544:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683558.878797:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789683558.878922:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:267f495e-c971-4db4-b237-3907c961127d:3305:1876618815580544:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789683558.880070:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683558.880764:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683558.881120:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683558.881154:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803003648 00000100:00100000:1.0:1789683558.881162:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803003648 00000100:00100000:2.0:1789683558.881169:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803003776 00000100:00100000:2.0:1789683558.881173:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803003776 00010000:00010000:2.0:1789683558.881196:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03e0 expref: 14 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881196:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0442 expref: 14 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683558.881226:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1789683558.881250:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+14:2353:x1876618803003776:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789683558.881265:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683558.881270:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03e0 expref: 14 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.881278:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03e0 expref: 14 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683558.881298:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789683558.881350:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76137480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+14:2353:x1876618803003776:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683558.881544:0:14394:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789683558.881566:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789683558.881618:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:1.0:1789683558.881633:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+14:2353:x1876618803003648:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683558.881642:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683558.881646:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0442 expref: 14 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881656:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0442 expref: 14 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881667:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881704:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881718:0:14396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683558.881722:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:1.0:1789683558.881726:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881732:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881739:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881744:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f800 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683558.881748:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881755:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881772:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.881783:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683558.881805:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76137b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:2353:x1876618803003648:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 174us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683558.881812:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00010000:00010000:1.0:1789683558.882520:0:16523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe76fc6000/0x59bee33f93ffd85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0442 expref: 12 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683558.882535:0:16523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815579904:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683558.882546:0:16523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7b909600/0x59bee33f93ffd4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f03e0 expref: 11 pid: 14404 timeout: 592 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683558.882555:0:16523:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16523:1876618815580032:192.168.203.60@tcp:104: 00010000:00010000:1.0:1789683558.882583:0:16523:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.882592:0:16523:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.882599:0:16523:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683558.882604:0:16523:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8dbe7c40f800/0x59bee33f93ffdaf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16523 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683559.008328:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683560.034523:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683560.224917:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683560.224998:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803003904 00000100:00100000:3.0:1789683560.225008:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803003904 00000100:00100000:3.0:1789683560.225063:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:3.0:1789683560.225073:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+11:13750:x1876618803003904:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683560.225091:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683560.225116:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbd44c96e00/0x59bee33f93ffdb6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0473 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.225140:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbd44c96e00/0x59bee33f93ffdb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0473 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.225150:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbd44c96e00/0x59bee33f93ffdb6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0473 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.225159:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c96e00, rc 0) 00000100:00100000:3.0:1789683560.225211:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13750:x1876618803003904:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 139us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683560.225217:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 104 00000100:00100000:1.0:1789683560.228737:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683560.228799:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803004032 00000100:00100000:2.0:1789683560.228811:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803004032 00000100:00100000:2.0:1789683560.228873:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:2.0:1789683560.228893:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13750:x1876618803004032:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789683560.229155:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13750:x1876618803004032:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 263us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683560.229164:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 105 00000100:00100000:2.0:1789683560.231166:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683560.231235:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803004160 00000100:00100000:1.0:1789683560.231244:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803004160 00000100:00100000:1.0:1789683560.231291:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:1.0:1789683560.231300:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe48dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13750:x1876618803004160:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.231666:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe48dc3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13750:x1876618803004160:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 366us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.231703:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 106 00000100:00100000:1.0:1789683560.241816:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683560.247248:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803004288 00000100:00100000:2.0:1789683560.247261:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803004288 00000100:00100000:3.0:1789683560.247441:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:3.0:1789683560.247451:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+12:13750:x1876618803004288:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683560.247468:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683560.247486:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbd44c96600/0x59bee33f93ffdbd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f047a expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.247528:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbd44c96600/0x59bee33f93ffdbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f047a expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.247539:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbd44c96600/0x59bee33f93ffdbd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f047a expref: 13 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.247548:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c96600, rc 0) 00000100:00100000:3.0:1789683560.247605:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13750:x1876618803004288:12345-192.168.203.60@tcp:101:ll_cfg_requeue.0 Request processed in 156us (5796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683560.247612:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 107 00000100:00100000:3.0:1789683560.249351:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683560.249587:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803004416 00000100:00100000:1.0:1789683560.249596:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803004416 00000100:00100000:1.0:1789683560.251707:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:1.0:1789683560.251729:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13750:x1876618803004416:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.252011:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13750:x1876618803004416:12345-192.168.203.60@tcp:501:ll_cfg_requeue.0 Request processed in 291us (2665us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.252019:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 108 00000100:00100000:2.0:1789683560.255185:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683560.257731:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803004544 00000100:00100000:1.0:1789683560.257744:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803004544 00000100:00100000:1.0:1789683560.257797:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 109 00000100:00100000:1.0:1789683560.257807:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13750:x1876618803004544:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.258028:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:13750:x1876618803004544:12345-192.168.203.60@tcp:503:ll_cfg_requeue.0 Request processed in 221us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.258036:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 109 10000000:01000000:1.0:1789683560.548916:0:14406:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789683560.548925:0:14406:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe46fc8800 from 10 10000000:01000000:1.0:1789683560.548931:0:14406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683560.548981:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7c00/0x59bee33f93ffdc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.548993:0:14406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7c00/0x59bee33f93ffdc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.549005:0:14406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7c00/0x59bee33f93ffdc4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683560.549030:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815580928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.549100:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683560.549145:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe530a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789683560.549169:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815580928 00000100:00100000:1.0:1789683560.549176:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815580928 00000100:00100000:1.0:1789683560.549221:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789683560.549230:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+16:14406:x1876618815580928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683560.549244:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683560.549258:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbe76fc6c00/0x59bee33f93ffdcb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffdc4 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.549283:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbe76fc6c00/0x59bee33f93ffdcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffdc4 expref: 17 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.549294:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbe76fc6c00/0x59bee33f93ffdcb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffdc4 expref: 17 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.549303:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc6c00, rc 0) 00000100:00100000:1.0:1789683560.549340:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+17:14406:x1876618815580928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.549347:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789683560.549406:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815580928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683560.549421:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7c00/0x59bee33f93ffdc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffdcb expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.549431:0:14406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7c00/0x59bee33f93ffdc4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffdcb expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683560.549480:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.549503:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683560.549521:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe530a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789683560.549533:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815581056 00000100:00100000:1.0:1789683560.549537:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815581056 00000100:00100000:1.0:1789683560.549557:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789683560.549564:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+17:14406:x1876618815581056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.551474:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+17:14406:x1876618815581056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1904us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.551484:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789683560.551549:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.551594:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.551636:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683560.551754:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe530a1780 going to sleep for 11 seconds 00000100:00100000:1.0:1789683560.551770:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815581184 00000100:00100000:1.0:1789683560.551777:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815581184 00000100:00100000:1.0:1789683560.551809:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789683560.551817:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+17:14406:x1876618815581184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.554204:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+17:14406:x1876618815581184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 2377us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.554225:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789683560.554350:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76136a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789683560.557412:0:16598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789683560.557577:0:14406:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789683560.557603:0:14406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683560.557614:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7c00/0x59bee33f93ffdc4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffdcb expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.557626:0:14406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7c00/0x59bee33f93ffdc4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffdcb expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683560.557636:0:14406:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789683560.557639:0:14406:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe75e5a000 from 10 10000000:01000000:1.0:1789683560.557641:0:14406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683560.557703:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7a00/0x59bee33f93ffdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.557711:0:14406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7a00/0x59bee33f93ffdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.557721:0:14406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7a00/0x59bee33f93ffdd2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683560.557744:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.557807:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683560.557846:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe455c8540 going to sleep for 11 seconds 00000100:00100000:3.0:1789683560.557930:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815581312 00000100:00100000:3.0:1789683560.557937:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815581312 00000100:00100000:3.0:1789683560.557974:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789683560.557983:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+17:14406:x1876618815581312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683560.557996:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683560.558009:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbd44c97e00/0x59bee33f93ffdd9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffdd2 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.558030:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbd44c97e00/0x59bee33f93ffdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffdd2 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.558040:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbd44c97e00/0x59bee33f93ffdd9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffdd2 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.558065:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c97e00, rc 0) 00000100:00100000:3.0:1789683560.558102:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+18:14406:x1876618815581312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683560.558109:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789683560.558189:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683560.558202:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7a00/0x59bee33f93ffdd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffdd9 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.558211:0:14406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7a00/0x59bee33f93ffdd2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffdd9 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683560.558265:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.558290:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683560.558312:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe455c8540 going to sleep for 11 seconds 00000100:00100000:1.0:1789683560.558325:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815581440 00000100:00100000:1.0:1789683560.558329:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815581440 00000100:00100000:1.0:1789683560.558355:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789683560.558362:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+18:14406:x1876618815581440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.558584:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+18:14406:x1876618815581440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.558590:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789683560.558619:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.558642:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.561154:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683560.561207:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52b4fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789683560.561716:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815581568 00000100:00100000:3.0:1789683560.561726:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815581568 00000100:00100000:3.0:1789683560.561776:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789683560.561785:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+18:14406:x1876618815581568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789683560.562062:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:267f495e-c971-4db4-b237-3907c961127d+18:14406:x1876618815581568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 277us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683560.562071:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1789683560.563080:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76134380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581568:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789683560.563953:0:16599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789683560.567420:0:14406:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789683560.567528:0:14406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789683560.567540:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7a00/0x59bee33f93ffdd2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffdd9 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.567553:0:14406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc7a00/0x59bee33f93ffdd2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffdd9 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789683560.567564:0:14406:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789683560.567566:0:14406:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8dbe529e1800 from 10 10000000:01000000:1.0:1789683560.567569:0:14406:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789683560.567604:0:14406:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6400/0x59bee33f93ffde0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.567620:0:14406:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6400/0x59bee33f93ffde0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.567632:0:14406:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6400/0x59bee33f93ffde0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683560.567655:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.567866:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683560.567978:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52b4f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683560.568020:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815581696 00000100:00100000:3.0:1789683560.568028:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815581696 00000100:00100000:3.0:1789683560.568076:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789683560.568086:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+18:14406:x1876618815581696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789683560.568100:0:14404:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683560.568112:0:14404:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8dbd44c96200/0x59bee33f93ffde7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x59bee33f93ffde0 expref: -99 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.568134:0:14404:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8dbd44c96200/0x59bee33f93ffde7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x59bee33f93ffde0 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.568145:0:14404:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8dbd44c96200/0x59bee33f93ffde7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x59bee33f93ffde0 expref: 19 pid: 14404 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683560.568153:0:14404:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c96200, rc 0) 00000100:00100000:3.0:1789683560.568205:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:14406:x1876618815581696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683560.568211:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1789683560.568238:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789683560.568252:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6400/0x59bee33f93ffde0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffde7 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683560.568261:0:14406:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6400/0x59bee33f93ffde0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x59bee33f93ffde7 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683560.568310:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.568336:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683560.568361:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52b4f840 going to sleep for 11 seconds 00000100:00100000:3.0:1789683560.568371:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815581824 00000100:00100000:3.0:1789683560.568375:0:14402:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815581824 00000100:00100000:3.0:1789683560.568402:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789683560.568409:0:14402:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:14406:x1876618815581824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789683560.568650:0:14402:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:267f495e-c971-4db4-b237-3907c961127d+19:14406:x1876618815581824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683560.568658:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1789683560.568816:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76135c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789683560.568853:0:14406:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789683560.568901:0:14406:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683560.568929:0:14406:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe497f49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789683560.569170:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815581952 00000100:00100000:1.0:1789683560.569175:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815581952 00000100:00100000:1.0:1789683560.569211:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1789683560.569218:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:14406:x1876618815581952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789683560.569370:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:14406:x1876618815581952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.569377:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1789683560.569788:0:14406:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:267f495e-c971-4db4-b237-3907c961127d:14406:1876618815581952:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789683560.572534:0:16601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1789683560.572753:0:14406:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1789683560.572781:0:14406:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.160@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789683560.572792:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6400/0x59bee33f93ffde0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffde7 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683560.572821:0:14406:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.160@tcp lock: ffff8dbe76fc6400/0x59bee33f93ffde0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x59bee33f93ffde7 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683560.927920:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789683560.927942:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815582080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789683560.928009:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683560.928248:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815582080 00000100:00100000:1.0:1789683560.928257:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815582080 00000100:00100000:1.0:1789683560.928309:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789683560.928319:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815582080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683560.928480:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815582464:0@lo:400:kworker.0 00000100:00100000:2.0:1789683560.928513:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683560.928537:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683560.928543:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815582336:0@lo:400:kworker.0 00000100:00100000:2.0:1789683560.928565:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683560.928589:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815582592:0@lo:400:kworker.0 00000100:00100000:2.0:1789683560.928615:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683560.928631:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683560.928636:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815582208:0@lo:400:kworker.0 00000100:00100000:2.0:1789683560.928658:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683560.929344:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789683560.929354:0:3304:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815582720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683560.929388:0:3304:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683560.929415:0:15096:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789683560.929424:0:15096:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:2.0:1789683560.929522:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815582720 00000100:00100000:2.0:1789683560.929528:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815582720 00000100:00100000:2.0:1789683560.929619:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683560.929629:0:16630:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815582720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789683560.929663:0:16630:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789683560.929732:0:16630:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815582720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683560.929748:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789683560.929792:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815582720:0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789683560.930095:0:15097:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789683560.930133:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815582080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1815us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.930140:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789683560.930160:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789683560.930165:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789683560.930181:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815582464 00000100:00100000:1.0:1789683560.930185:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815582464 00000100:00100000:1.0:1789683560.930218:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815582336 00000100:00100000:1.0:1789683560.930221:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815582336 00000100:00100000:1.0:1789683560.930233:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815582592 00000100:00100000:1.0:1789683560.930236:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815582592 00000100:00100000:1.0:1789683560.930250:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683560.930256:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815582464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683560.930296:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815582464:12345-0@lo:400:kworker.0 Request processed in 40us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.930302:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789683560.930315:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683560.930321:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815582336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683560.930364:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815582336:12345-0@lo:400:kworker.0 Request processed in 43us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.930370:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789683560.930382:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683560.930387:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815582592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683560.930429:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876618815582592:12345-0@lo:400:kworker.0 Request processed in 42us (1813us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.930434:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789683560.930460:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815582208 00000100:00100000:1.0:1789683560.930463:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815582208 00000100:00100000:1.0:1789683560.930484:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789683560.930489:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815582208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789683560.930520:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876618815582208:12345-0@lo:400:kworker.0 Request processed in 30us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683560.930525:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1789683560.930540:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789683560.930564:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815582336:0@lo:400:kworker.0 00000100:00100000:1.0:1789683560.930576:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815582464:0@lo:400:kworker.0 00000100:00100000:1.0:1789683560.930607:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876618815582208:0@lo:400:kworker.0 00000100:00100000:1.0:1789683560.930616:0:3304:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876618815582592:0@lo:400:kworker.0 00000100:00100000:0.0:1789683560.931030:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76ce7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815582080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789683561.062270:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789683562.079982:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789683562.413908:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.414255:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803004672 00000100:00100000:2.0:1789683562.414266:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803004672 00000100:00100000:2.0:1789683562.414356:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:2.0:1789683562.414369:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+6:14406:x1876618803004672:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683562.414390:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.414412:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffdee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0481 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.414479:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.414494:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.414507:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.414522:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.414529:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.414536:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789683562.414969:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789683562.415136:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ffe03 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415154:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ffe03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415162:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ffe03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683562.415188:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683562.415191:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683562.415228:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ffe03 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415240:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415246:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415253:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415259:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.415263:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415270:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415281:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5ada6000) 00010000:00010000:2.0:1789683562.415284:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.415289:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415305:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffdf5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415319:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415324:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415329:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415333:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.415336:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415340:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415347:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8dbe6097c000) 00010000:00010000:2.0:1789683562.415350:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.415353:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415358:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffdfc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415389:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffdee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0481 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415400:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908800/0x59bee33f93ffe03 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0481 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.415413:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dbe6097c100) 00010000:00010000:2.0:1789683562.415415:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683562.415417:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908800, rc 0) 00000100:00100000:2.0:1789683562.415496:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76135c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+7:14406:x1876618803004672:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1130us (1600us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683562.415503:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:1.0:1789683562.426226:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.426322:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803004928 00000100:00100000:2.0:1789683562.426333:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803004928 00000100:00100000:2.0:1789683562.426394:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:2.0:1789683562.426405:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+7:14406:x1876618803004928:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683562.426429:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.426450:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0488 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.426538:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.426551:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.426563:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.426584:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.426591:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.426611:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.426990:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ffe1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.426999:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ffe1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427006:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ffe1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683562.427014:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789683562.427208:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427216:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427222:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427228:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.427232:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427239:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427250:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8dbe6097c100) 00010000:00010000:2.0:1789683562.427253:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.427263:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427270:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427282:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427288:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427293:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427298:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.427301:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427306:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427313:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8dbe6097c000) 00010000:00010000:2.0:1789683562.427315:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.427318:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427323:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe18 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427819:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0488 expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427848:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909800/0x59bee33f93ffe1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0488 expref: 9 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.427855:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe6097c800) 00010000:00010000:2.0:1789683562.427867:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.427870:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909800, rc 0) 00000100:00100000:2.0:1789683562.427934:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76134380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+9:14406:x1876618803004928:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1531us (1717us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789683562.427943:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:0.0:1789683562.432248:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.432325:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803005056 00000100:00100000:2.0:1789683562.432335:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803005056 00000100:00100000:2.0:1789683562.432395:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:2.0:1789683562.432406:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+9:14406:x1876618803005056:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789683562.432531:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+9:14406:x1876618803005056:12345-192.168.203.60@tcp:59:lhsmtool_posix.0 Request processed in 126us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683562.432538:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1789683562.494129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.494292:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803005184 00000100:00100000:2.0:1789683562.494304:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803005184 00000100:00100000:2.0:1789683562.494369:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:2.0:1789683562.494380:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+9:14412:x1876618803005184:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683562.494400:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.494425:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f048f expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494494:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494597:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494610:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494627:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494635:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494641:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494879:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494888:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494895:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494901:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909400 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.494906:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494912:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494924:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5ada6000) 00010000:00010000:2.0:1789683562.494933:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.494939:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494946:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494960:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494965:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494972:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494977:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.494980:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494986:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.494993:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dbe6097c000) 00010000:00010000:2.0:1789683562.494996:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.494998:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.495003:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe3b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.495037:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe2d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f048f expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.495057:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5ada6000) 00010000:00010000:2.0:1789683562.495059:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.495063:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f048f expref: 10 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.495073:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909a00, rc 0) 00000100:00100000:2.0:1789683562.495272:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+9:14412:x1876618803005184:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 893us (1151us total) trans 0 rc 301/301 00000100:00100000:2.0:1789683562.495282:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 18 00000100:00100000:1.0:1789683562.504364:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683562.504468:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803005312 00000100:00100000:3.0:1789683562.504479:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803005312 00000100:00100000:3.0:1789683562.504545:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:3.0:1789683562.504556:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f78a790a-0341-4215-9612-09be69631436+9:14412:x1876618803005312:12345-192.168.203.60@tcp:700:lfs.0 00000100:00100000:3.0:1789683562.504655:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76136a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f78a790a-0341-4215-9612-09be69631436+9:14412:x1876618803005312:12345-192.168.203.60@tcp:700:lfs.0 Request processed in 100us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683562.504662:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1789683562.510418:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.511002:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803005568 00000100:00100000:2.0:1789683562.511013:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803005568 00000100:00100000:2.0:1789683562.511130:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 19 00000100:00100000:2.0:1789683562.511142:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+9:14412:x1876618803005568:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:2.0:1789683562.511207:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683562.511236:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93ffd70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f040a expref: 9 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.511258:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5ada6000) 00010000:00010000:2.0:1789683562.511263:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683562.511506:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.511521:0:14410:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f046c expref: 5 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.511530:0:14410:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.511571:0:14410:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f046c expref: 5 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.511597:0:14410:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f046c expref: 5 pid: 16284 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683562.511613:0:14410:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1876618815582848:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683562.511827:0:14410:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53eaab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683562.525457:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.527122:0:14410:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14410:1876618815582848:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683562.527153:0:14410:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683562.527499:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803005696 00000100:00100000:1.0:1789683562.527507:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803005696 00010000:00010000:1.0:1789683562.527734:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f046c expref: 6 pid: 16284 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683562.527772:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1789683562.527782:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:2352:x1876618803005696:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683562.527832:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683562.527840:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f046c expref: 6 pid: 16284 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.527854:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f046c expref: 6 pid: 16284 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.527892:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffda8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f046c expref: 6 pid: 16284 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.527910:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5ada6000) 00010000:00010000:1.0:1789683562.527916:0:14396:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.527926:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.527934:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.527958:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683562.527969:0:14410:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.527978:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.528006:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.528016:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683562.528021:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:2352:x1876618803005696:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 240us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683562.528029:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00010000:00010000:3.0:1789683562.528031:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789683562.528438:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789683562.529347:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00200000:0.0:1789683562.531399:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789683562.531419:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.531430:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.531439:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.531444:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683562.531449:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.531464:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.531494:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe5ada6000) 00010000:00010000:0.0:1789683562.531497:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683562.531502:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.531509:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe42 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789683562.531531:0:14410:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e369334 reply state 00000000f000ded4 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683562.531541:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683562.531650:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+10:14412:x1876618803005568:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 20506us (21237us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789683562.531659:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 19 00010000:00010000:1.0:1789683562.541158:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.541177:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.541213:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.541219:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683562.541224:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.541232:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.541249:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dbe5ada6400) 00010000:00010000:1.0:1789683562.541252:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789683562.541257:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.541264:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffe49 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683562.644546:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.644902:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803005824 00000100:00100000:2.0:1789683562.644912:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803005824 00000100:00100000:2.0:1789683562.644975:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:2.0:1789683562.644986:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+9:14420:x1876618803005824:12345-192.168.203.60@tcp:101:lctl.0 00010000:00010000:2.0:1789683562.645009:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.645032:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0496 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.645097:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.645110:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.645140:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683562.645181:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683562.645185:0:14409:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683562.645248:0:14409:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.645273:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0496 expref: 11 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.645292:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909400/0x59bee33f93ffe57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0496 expref: 10 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.645300:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:2.0:1789683562.645303:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683562.645306:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909400, rc 0) 00000100:00100000:2.0:1789683562.645379:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+10:14420:x1876618803005824:12345-192.168.203.60@tcp:101:lctl.0 Request processed in 395us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683562.645386:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 20 00000100:00100000:0.0:1789683562.668935:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683562.669087:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803005952 00000100:00100000:3.0:1789683562.669100:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803005952 00000100:00100000:3.0:1789683562.669165:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1789683562.669175:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:14421:x1876618803005952:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683562.669193:0:16284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683562.669214:0:16284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93ffe5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f049d expref: -99 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.669270:0:16284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96000/0x59bee33f93ffe65 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.669283:0:16284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96000/0x59bee33f93ffe65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.669294:0:16284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96000/0x59bee33f93ffe65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683562.669328:0:16284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789683562.669331:0:16284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683562.669346:0:16284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96000/0x59bee33f93ffe65 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.669366:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93ffe5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f049d expref: 7 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.669382:0:16284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96000/0x59bee33f93ffe65 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f049d expref: 6 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.669403:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:3.0:1789683562.669406:0:16284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789683562.669409:0:16284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c96000, rc 0) 00000100:00100000:3.0:1789683562.669478:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:14421:x1876618803005952:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 304us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683562.669495:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 21 00000100:00100000:3.0:1789683562.671955:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.672050:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803006080 00000100:00100000:2.0:1789683562.672059:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803006080 00000100:00100000:2.0:1789683562.672116:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1789683562.672126:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+6:14421:x1876618803006080:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683562.672146:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.672166:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04a4 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672247:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672260:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672272:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672287:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672294:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672301:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672387:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffe81 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672394:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffe81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672400:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffe81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683562.672428:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683562.672431:0:14409:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683562.672450:0:14409:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffe81 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672472:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672478:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672500:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672505:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.672510:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672517:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672529:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:2.0:1789683562.672533:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.672538:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672544:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffe73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672557:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672564:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672570:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672593:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.672596:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672603:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672612:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dbe6097c300) 00010000:00010000:2.0:1789683562.672614:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.672618:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672624:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffe7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672655:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04a4 expref: 8 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672668:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffe81 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04a4 expref: 7 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.672722:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:2.0:1789683562.672725:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683562.672727:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909600, rc 0) 00000100:00100000:2.0:1789683562.672783:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+7:14421:x1876618803006080:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 659us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683562.672791:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:1.0:1789683562.678028:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683562.678224:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803006336 00000100:00100000:3.0:1789683562.678234:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803006336 00000100:00100000:3.0:1789683562.678291:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1789683562.678302:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95ed2437-53bb-4455-b4ea-65cc54f01d1f+7:14421:x1876618803006336:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683562.678322:0:16284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683562.678342:0:16284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93ffe88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04ab expref: -99 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683562.678429:0:16284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789683562.678544:0:16284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93ffe88 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ab expref: 9 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.678557:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:3.0:1789683562.678559:0:16284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683562.678565:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93ffe88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ab expref: 9 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.678589:0:16284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c96a00, rc 0) 00000100:00100000:3.0:1789683562.678648:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95ed2437-53bb-4455-b4ea-65cc54f01d1f+8:14421:x1876618803006336:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 347us (629us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1789683562.678668:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:0.0:1789683562.681476:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.681588:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803006592 00000100:00100000:2.0:1789683562.681610:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803006592 00000100:00100000:2.0:1789683562.681668:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 24 00000100:00100000:2.0:1789683562.681707:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+8:14421:x1876618803006592:12345-192.168.203.60@tcp:36:lfs.0 00010000:00010000:2.0:1789683562.681761:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789683562.681786:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffe81 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04a4 expref: 8 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.681803:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dbe6097cb00) 00010000:00010000:2.0:1789683562.681813:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789683562.681849:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.681870:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.681880:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683562.682085:0:14409:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a97e0f9 reply state 000000006e275334 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683562.682094:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789683562.682100:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789683562.682181:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+9:14421:x1876618803006592:12345-192.168.203.60@tcp:36:lfs.0 Request processed in 476us (714us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1789683562.682188:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 24 00010000:00010000:2.0:1789683562.684024:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.684038:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.684056:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.684061:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.684066:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.684072:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.684086:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:2.0:1789683562.684089:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789683562.684093:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.684098:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffe96 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683562.685400:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683562.685493:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803006848 00000100:00100000:3.0:1789683562.685503:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803006848 00000100:00100000:3.0:1789683562.685557:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1789683562.685567:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+8:14421:x1876618803006848:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:3.0:1789683562.685850:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+9:14421:x1876618803006848:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 282us (457us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789683562.685868:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:1.0:1789683562.688903:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683562.689058:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803007104 00000100:00100000:3.0:1789683562.689068:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803007104 00000100:00100000:3.0:1789683562.689127:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:3.0:1789683562.689137:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95ed2437-53bb-4455-b4ea-65cc54f01d1f+9:14421:x1876618803007104:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:3.0:1789683562.689161:0:16284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683562.689180:0:16284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93ffe9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04b2 expref: -99 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.689255:0:16284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.689270:0:16284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.689281:0:16284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.689297:0:16284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.689322:0:16284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.689329:0:16284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683562.689898:0:16284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789683562.689984:0:16284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.689993:0:16284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690000:0:16284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690006:0:16284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683562.690010:0:16284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690017:0:16284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690029:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:3.0:1789683562.690031:0:16284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683562.690036:0:16284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690042:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93ffea4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690065:0:16284:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690071:0:16284:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690078:0:16284:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690082:0:16284:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683562.690085:0:16284:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690091:0:16284:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690098:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dbe5ada6600) 00010000:00010000:3.0:1789683562.690100:0:16284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683562.690103:0:16284:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690108:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93ffeab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690142:0:16284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93ffe9d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b2 expref: 11 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690151:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:3.0:1789683562.690154:0:16284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683562.690162:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93ffe9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b2 expref: 11 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.690171:0:16284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c96a00, rc 0) 00000100:00100000:3.0:1789683562.690231:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:95ed2437-53bb-4455-b4ea-65cc54f01d1f+10:14421:x1876618803007104:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 1095us (1336us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789683562.690239:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 25 00000100:00100000:1.0:1789683562.693454:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.693611:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803007232 00000100:00100000:2.0:1789683562.693621:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803007232 00000100:00100000:2.0:1789683562.693722:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:2.0:1789683562.693732:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+10:14421:x1876618803007232:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683562.693759:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.693783:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffeb9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04b9 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.693895:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.693909:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.693937:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683562.693964:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683562.693968:0:14409:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683562.693984:0:14409:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.694012:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffeb9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b9 expref: 12 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.694031:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b9 expref: 11 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.694040:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:2.0:1789683562.694043:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789683562.694047:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909600, rc 0) 00000100:00100000:2.0:1789683562.694106:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+11:14421:x1876618803007232:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 375us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683562.694113:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 26 00000100:00100000:0.0:1789683562.699715:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683562.699925:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803007360 00000100:00100000:3.0:1789683562.699936:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803007360 00000100:00100000:3.0:1789683562.699991:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:3.0:1789683562.700003:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+11:14421:x1876618803007360:12345-192.168.203.60@tcp:37:lfs.0 00000100:00100000:2.0:1789683562.704323:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+11:14421:x1876618803007360:12345-192.168.203.60@tcp:37:lfs.0 Request processed in 4312us (4646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683562.704336:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1789683562.708281:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683562.708379:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803007616 00000100:00100000:0.0:1789683562.708389:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803007616 00000100:00100000:0.0:1789683562.708450:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1789683562.708461:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bdd0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+11:14421:x1876618803007616:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:0.0:1789683562.708745:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bdd0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+12:14421:x1876618803007616:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 285us (473us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789683562.708771:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1789683562.749294:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.749377:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803007744 00000100:00100000:2.0:1789683562.749386:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803007744 00000100:00100000:2.0:1789683562.749437:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:2.0:1789683562.749447:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+10:14427:x1876618803007744:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1789683562.749586:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.749607:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffec7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04c0 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.749668:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.749717:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.749729:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.749742:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.749749:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.749755:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750007:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ffedc lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750016:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ffedc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750023:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ffedc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683562.750050:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789683562.750062:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789683562.750107:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ffedc lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750119:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750126:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750132:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750138:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.750142:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750149:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750161:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:2.0:1789683562.750164:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.750169:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750175:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93ffece lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750187:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750192:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750208:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750213:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.750215:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750221:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750229:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8dbe6097cb00) 00010000:00010000:2.0:1789683562.750232:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.750235:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750241:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffed5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750273:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffec7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c0 expref: 12 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750286:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908c00/0x59bee33f93ffedc lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c0 expref: 11 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.750293:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:2.0:1789683562.750295:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789683562.750298:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908c00, rc 0) 00000100:00100000:2.0:1789683562.750410:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+11:14427:x1876618803007744:12345-192.168.203.60@tcp:101:bash.0 Request processed in 963us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683562.750426:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 27 00000100:00100000:3.0:1789683562.754119:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.754193:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803008000 00000100:00100000:2.0:1789683562.754202:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803008000 00000100:00100000:2.0:1789683562.754258:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 28 00000100:00100000:2.0:1789683562.754267:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+11:14427:x1876618803008000:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:2.0:1789683562.754286:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.754305:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ffee3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04c7 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.754420:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.754434:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b9 expref: 11 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.754443:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.754475:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b9 expref: 11 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.754498:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b9 expref: 11 pid: 14409 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683562.754511:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1876618815582976:192.168.203.60@tcp:104: 00000100:00100000:2.0:1789683562.754622:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe53eaa780 going to sleep for 11 seconds 00000100:00100000:1.0:1789683562.758165:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.758212:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14409:1876618815582976:192.168.203.60@tcp:104: 00010000:00010000:2.0:1789683562.758258:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683562.758952:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803008128 00000100:00100000:3.0:1789683562.758960:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803008128 00010000:00010000:3.0:1789683562.758999:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b9 expref: 12 pid: 14409 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683562.759041:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1789683562.759050:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+12:2353:x1876618803008128:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789683562.759066:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683562.759074:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b9 expref: 12 pid: 14409 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.759087:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b9 expref: 12 pid: 14409 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.759111:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909600/0x59bee33f93ffec0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04b9 expref: 12 pid: 14409 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.759150:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:3.0:1789683562.759156:0:14394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.759166:0:14394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.759174:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.759249:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789683562.759313:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:95ed2437-53bb-4455-b4ea-65cc54f01d1f+11:2353:x1876618803008128:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 264us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683562.759320:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00010000:00010000:2.0:1789683562.759906:0:14409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.759917:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.759939:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.759949:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.759958:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761083:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761095:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761104:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683562.761115:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789683562.761155:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761163:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761468:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761474:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b908a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683562.761478:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761486:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761507:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:2.0:1789683562.761510:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683562.761521:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761528:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93ffeea lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789683562.761543:0:14409:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000efa8c638 reply state 000000008da9fd46 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683562.761551:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789683562.761588:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93ffee3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c7 expref: 14 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761602:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c7 expref: 13 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.761610:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:2.0:1789683562.761612:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789683562.761621:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909a00, rc 0) 00000100:00100000:2.0:1789683562.761722:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b918a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+14:14427:x1876618803008000:12345-192.168.203.60@tcp:101:bash.0 Request processed in 7455us (7611us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789683562.761732:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 28 00010000:00010000:0.0:1789683562.772961:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.772981:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.772989:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.772995:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683562.773000:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.773008:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.773024:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8dbe6097cb00) 00010000:00010000:0.0:1789683562.773027:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683562.773031:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.773038:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909200/0x59bee33f93ffef1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683562.787597:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683562.787716:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803008256 00000100:00100000:3.0:1789683562.787727:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803008256 00000100:00100000:3.0:1789683562.787792:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:3.0:1789683562.787803:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+13:14427:x1876618803008256:12345-192.168.203.60@tcp:101:bash.0 00010000:00010000:3.0:1789683562.787834:0:16284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683562.787854:0:16284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff06 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04ce expref: -99 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.787933:0:16284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.787948:0:16284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.787963:0:16284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683562.788024:0:16284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789683562.788029:0:16284:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683562.788053:0:16284:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.788063:0:16284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.788088:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff06 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ce expref: 15 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.788107:0:16284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ce expref: 14 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683562.788114:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:3.0:1789683562.788117:0:16284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789683562.788121:0:16284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c96a00, rc 0) 00000100:00100000:3.0:1789683562.788239:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+14:14427:x1876618803008256:12345-192.168.203.60@tcp:101:bash.0 Request processed in 438us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683562.788247:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 29 00000100:00100000:1.0:1789683562.795970:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683562.797960:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803008512 00000100:00100000:0.0:1789683562.797981:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803008512 00000100:00100000:0.0:1789683562.798058:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1789683562.798070:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78a790a-0341-4215-9612-09be69631436+14:14427:x1876618803008512:12345-192.168.203.60@tcp:35:bash.0 00000100:00100000:0.0:1789683562.798737:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78a790a-0341-4215-9612-09be69631436+15:14427:x1876618803008512:12345-192.168.203.60@tcp:35:bash.0 Request processed in 666us (2774us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789683562.798746:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:1.0:1789683562.895380:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.895659:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803008768 00000100:00100000:2.0:1789683562.895670:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803008768 00000100:00100000:2.0:1789683562.895824:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:2.0:1789683562.895835:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+15:14437:x1876618803008768:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683562.895871:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.895894:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fff14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04d5 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683562.895990:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789683562.896104:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fff14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04d5 expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.896117:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8dbe6097c000) 00010000:00010000:2.0:1789683562.896121:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789683562.896126:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fff14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04d5 expref: 17 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.896140:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908e00, rc 0) 00000100:00100000:2.0:1789683562.896220:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+16:14437:x1876618803008768:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 387us (850us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789683562.896228:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 30 00000100:00100000:1.0:1789683562.898984:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.899050:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803009024 00000100:00100000:2.0:1789683562.899059:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803009024 00000100:00100000:2.0:1789683562.899115:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1789683562.899138:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+16:14437:x1876618803009024:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1789683562.899384:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+17:14437:x1876618803009024:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 247us (407us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789683562.899391:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:0.0:1789683562.945478:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.945640:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803009280 00000100:00100000:2.0:1789683562.945651:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803009280 00000100:00100000:2.0:1789683562.945737:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:2.0:1789683562.945748:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+17:14440:x1876618803009280:12345-192.168.203.60@tcp:101:lfs.0 00010000:00010000:2.0:1789683562.945772:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683562.945793:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fff22 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04dc expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.945919:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93fff29 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.945935:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93fff29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.945946:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93fff29 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683562.945959:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789683562.946084:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fff22 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04dc expref: 20 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.946104:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93fff29 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04dc expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683562.946129:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:2.0:1789683562.946132:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683562.946136:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908a00, rc 0) 00000100:00100000:2.0:1789683562.946196:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+19:14440:x1876618803009280:12345-192.168.203.60@tcp:101:lfs.0 Request processed in 449us (726us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789683562.946203:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 31 00000100:00100000:3.0:1789683562.950048:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683562.950101:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683562.950249:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803009536 00000100:00100000:0.0:1789683562.950260:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803009536 00000100:00100000:0.0:1789683562.950326:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1789683562.950337:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78a790a-0341-4215-9612-09be69631436+19:2353:x1876618803009536:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683562.950353:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683562.950377:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908a00/0x59bee33f93fff29 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04dc expref: 19 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683562.950396:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:0.0:1789683562.950402:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683562.950461:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78a790a-0341-4215-9612-09be69631436+18:2353:x1876618803009536:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 125us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683562.950469:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1789683562.950917:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803009408 00000100:00100000:1.0:1789683562.950935:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803009408 00000100:00100000:1.0:1789683562.950976:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:1.0:1789683562.950983:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+18:14440:x1876618803009408:12345-192.168.203.60@tcp:54:lfs.0 00010000:00010000:1.0:1789683562.951038:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.951052:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.951061:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.951086:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.951092:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.951099:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.951105:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6600 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683562.951110:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.951117:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.951126:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:1.0:1789683562.951128:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789683562.951133:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683562.951149:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc6600/0x59bee33f93fff37 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683562.951198:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+18:14440:x1876618803009408:12345-192.168.203.60@tcp:54:lfs.0 Request processed in 215us (1096us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683562.951206:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 32 00000100:00100000:3.0:1789683562.954066:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683562.954166:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803009792 00000100:00100000:2.0:1789683562.954176:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803009792 00000100:00100000:2.0:1789683562.954228:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1789683562.954239:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+18:14440:x1876618803009792:12345-192.168.203.60@tcp:35:lfs.0 00000100:00100000:2.0:1789683562.954478:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+19:14440:x1876618803009792:12345-192.168.203.60@tcp:35:lfs.0 Request processed in 239us (420us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789683562.954500:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:3.0:1789683563.103898:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789683563.172466:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.172516:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.172552:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.172583:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.172609:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.172626:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.172648:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.172670:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803010176 00000100:00100000:0.0:1789683563.172721:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803010176 00000100:00100000:0.0:1789683563.172777:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803010688 00000100:00100000:0.0:1789683563.172781:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803010688 00000100:00100000:0.0:1789683563.172793:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803010304 00000100:00100000:0.0:1789683563.172795:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803010304 00000100:00100000:0.0:1789683563.172806:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803010560 00000100:00100000:0.0:1789683563.172808:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803010560 00000100:00100000:0.0:1789683563.172825:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1789683563.172834:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+5:2354:x1876618803010176:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683563.172916:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+5:2354:x1876618803010176:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 83us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.172924:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:0.0:1789683563.172942:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1789683563.172948:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:2354:x1876618803010688:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683563.172972:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:2354:x1876618803010688:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 23us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.172977:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1789683563.172988:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1789683563.172993:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+5:2354:x1876618803010304:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683563.173012:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+5:2354:x1876618803010304:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 20us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.173018:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1789683563.173027:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1789683563.173033:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:2354:x1876618803010560:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:0.0:1789683563.173054:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:95ed2437-53bb-4455-b4ea-65cc54f01d1f+5:2354:x1876618803010560:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 21us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.173068:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00080000:2.0:1789683563.173180:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789683563.173185:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789683563.173217:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803010432 00000100:00100000:2.0:1789683563.173221:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803010432 00000100:00100000:2.0:1789683563.173261:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803010048 00000100:00100000:2.0:1789683563.173266:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803010048 00000100:00100000:2.0:1789683563.173285:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1789683563.173291:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+11:2354:x1876618803010432:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683563.173324:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:95ed2437-53bb-4455-b4ea-65cc54f01d1f+11:2354:x1876618803010432:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 33us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683563.173330:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 22 00000100:00100000:2.0:1789683563.173344:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:2.0:1789683563.173356:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+19:2354:x1876618803010048:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:2.0:1789683563.173384:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+19:2354:x1876618803010048:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 28us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683563.173390:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 23 00000100:00100000:3.0:1789683563.173606:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803009920 00000100:00100000:3.0:1789683563.173612:0:14403:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803009920 00000100:00100000:3.0:1789683563.173649:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:3.0:1789683563.173656:0:14403:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:2354:x1876618803009920:12345-192.168.203.60@tcp:400:kworker.0 00000100:00100000:3.0:1789683563.173712:0:14403:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e3ec037e-101a-4c9b-8daf-a9c299fb8628+13:2354:x1876618803009920:12345-192.168.203.60@tcp:400:kworker.0 Request processed in 56us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683563.173719:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 119 00000100:00100000:3.0:1789683563.294546:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683563.296662:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803010944 00000100:00100000:2.0:1789683563.296712:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803010944 00000100:00100000:2.0:1789683563.296801:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:2.0:1789683563.296812:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+19:14471:x1876618803010944:12345-192.168.203.60@tcp:101:cat.0 00010000:00010000:2.0:1789683563.296832:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683563.296861:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fff3e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04e3 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.297715:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93fff45 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.297730:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93fff45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.297742:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93fff45 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789683563.297754:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789683563.297911:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fff3e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04e3 expref: 22 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.297930:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93fff45 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04e3 expref: 21 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.297956:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:2.0:1789683563.297959:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683563.297963:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b909c00, rc 0) 00000100:00100000:2.0:1789683563.298040:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b919500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+21:14471:x1876618803010944:12345-192.168.203.60@tcp:101:cat.0 Request processed in 1229us (3507us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789683563.298048:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 33 00000100:00100000:3.0:1789683563.305048:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683563.305303:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803011328 00000100:00100000:2.0:1789683563.305322:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803011328 00000100:00100000:2.0:1789683563.305402:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:2.0:1789683563.305415:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+21:14471:x1876618803011328:12345-192.168.203.60@tcp:35:cat.0 00000100:00100000:2.0:1789683563.305776:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+22:14471:x1876618803011328:12345-192.168.203.60@tcp:35:cat.0 Request processed in 363us (741us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789683563.305783:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 8 00000100:00100000:0.0:1789683563.308280:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683563.308439:0:16525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803011072 00000100:00100000:1.0:1789683563.308455:0:16525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803011072 00000100:00100000:1.0:1789683563.308561:0:16525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1789683563.308571:0:16525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f78a790a-0341-4215-9612-09be69631436+22:2352:x1876618803011072:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683563.308587:0:16525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683563.308611:0:16525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f93fff45 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04e3 expref: 22 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.308633:0:16525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:1.0:1789683563.308638:0:16525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683563.308746:0:16525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f78a790a-0341-4215-9612-09be69631436+21:2352:x1876618803011072:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 177us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683563.308754:0:16525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:0.0:1789683563.378583:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.378786:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803011584 00000100:00100000:3.0:1789683563.378801:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803011584 00000100:00100000:3.0:1789683563.378899:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:3.0:1789683563.378913:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+21:14477:x1876618803011584:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1789683563.378949:0:16284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683563.378979:0:16284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff53 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04ea expref: -99 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.379138:0:16284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.379157:0:16284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c7 expref: 22 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.379168:0:16284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ce expref: 22 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.379177:0:16284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.379227:0:16284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ce expref: 22 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.379269:0:16284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ce expref: 22 pid: 16284 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683563.379288:0:16284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16284:1876618815583104:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683563.379419:0:16284:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c7 expref: 22 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.379430:0:16284:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c7 expref: 22 pid: 14409 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683563.379441:0:16284:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16284:1876618815583232:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683563.379470:0:16284:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe52b4fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789683563.380992:0:16284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16284:1876618815583104:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683563.381397:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683563.381538:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803011840 00000100:00100000:1.0:1789683563.381554:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803011840 00010000:00010000:1.0:1789683563.381602:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c7 expref: 23 pid: 14409 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683563.381655:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:1.0:1789683563.381666:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d65fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78a790a-0341-4215-9612-09be69631436+23:2352:x1876618803011840:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683563.381733:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683563.381742:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c7 expref: 23 pid: 14409 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.381757:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c7 expref: 23 pid: 14409 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.381784:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:1.0:1789683563.381791:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.381801:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.381813:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683563.381819:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909a00/0x59bee33f93ffef8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04c7 expref: 23 pid: 14409 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683563.381849:0:16284:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f34a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16284:1876618815583232:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683563.381906:0:16284:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683563.381907:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d65fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78a790a-0341-4215-9612-09be69631436+22:2352:x1876618803011840:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 237us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683563.381938:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:3.0:1789683563.384316:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683563.384622:0:16525:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803011712 00000100:00100000:1.0:1789683563.384637:0:16525:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803011712 00010000:00010000:1.0:1789683563.384703:0:16525:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ce expref: 22 pid: 16284 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683563.384808:0:16525:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:1.0:1789683563.384818:0:16525:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f78a790a-0341-4215-9612-09be69631436+22:2353:x1876618803011712:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683563.384833:0:16525:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683563.384840:0:16525:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ce expref: 22 pid: 16284 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.384888:0:16525:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ce expref: 22 pid: 16284 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.384910:0:16525:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96a00/0x59bee33f93fff0d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ce expref: 22 pid: 16284 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.384929:0:16525:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:1.0:1789683563.384934:0:16525:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.384943:0:16525:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.384951:0:16525:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.384986:0:16525:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683563.385048:0:16525:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f78a790a-0341-4215-9612-09be69631436+21:2353:x1876618803011712:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 231us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683563.385055:0:16525:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00010000:00010000:3.0:1789683563.385120:0:16284:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.385135:0:16284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683563.385184:0:16284:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789683563.385425:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff53 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ea expref: 22 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.385449:0:16284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97600/0x59bee33f93fff5a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ea expref: 21 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.385459:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:3.0:1789683563.385462:0:16284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789683563.385466:0:16284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c97600, rc 0) 00000100:00100000:3.0:1789683563.385538:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+21:14477:x1876618803011584:12345-192.168.203.60@tcp:101:dd.0 Request processed in 6628us (6970us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789683563.385547:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 34 00000100:00100000:0.0:1789683563.391213:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.391350:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803012096 00000100:00100000:3.0:1789683563.391366:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803012096 00000100:00100000:3.0:1789683563.391441:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 35 00000100:00100000:3.0:1789683563.391454:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+21:14477:x1876618803012096:12345-192.168.203.60@tcp:36:dd.0 00010000:00010000:3.0:1789683563.392516:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.392541:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.392556:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683563.393760:0:14411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789683563.394974:0:14411:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000707c4f09 reply state 00000000a9dceaea transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683563.394989:0:14411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683563.395462:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+24:14477:x1876618803012096:12345-192.168.203.60@tcp:36:dd.0 Request processed in 4003us (4259us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789683563.395474:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 35 00000020:00080000:3.0:1789683563.395485:0:14411:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789683563.401558:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683563.401631:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803012224 00000100:00100000:1.0:1789683563.401646:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803012224 00000100:00100000:1.0:1789683563.401754:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 36 00000100:00100000:1.0:1789683563.401765:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+24:14477:x1876618803012224:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:1.0:1789683563.401792:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789683563.401811:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93fff6f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04f1 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.402004:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.402013:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.402021:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.402644:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93fff6f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f1 expref: 25 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.402666:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93fff6f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f1 expref: 25 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.402771:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:1.0:1789683563.402774:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683563.402779:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe76fc7800, rc 0) 00000100:00100000:1.0:1789683563.402977:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76ce5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+25:14477:x1876618803012224:12345-192.168.203.60@tcp:101:dd.0 Request processed in 1213us (1434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683563.402986:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 36 00010000:00010000:2.0:1789683563.403988:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683563.403999:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.404011:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.404043:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:2.0:1789683563.404046:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683563.404052:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.404060:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97200/0x59bee33f93fff68 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683563.419804:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.420067:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803012480 00000100:00100000:0.0:1789683563.420152:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803012480 00000100:00100000:0.0:1789683563.420305:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1789683563.420320:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78a790a-0341-4215-9612-09be69631436+24:14477:x1876618803012480:12345-192.168.203.60@tcp:103:dd.0 00010000:00010000:0.0:1789683563.420341:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683563.420374:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7800/0x59bee33f93fff6f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f1 expref: 24 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.420400:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:0.0:1789683563.420407:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683563.420488:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f78a790a-0341-4215-9612-09be69631436+23:14477:x1876618803012480:12345-192.168.203.60@tcp:103:dd.0 Request processed in 172us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.420504:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:3.0:1789683563.426402:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683563.427078:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803012608 00000100:00100000:1.0:1789683563.427093:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803012608 00000100:00100000:1.0:1789683563.427174:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:1.0:1789683563.427187:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+23:14477:x1876618803012608:12345-192.168.203.60@tcp:58:dd.0 00010000:00010000:1.0:1789683563.427319:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.427341:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.427356:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789683563.429162:0:14410:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789683563.429377:0:14410:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1789683563.429475:0:14410:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1789683563.430069:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+23:14477:x1876618803012608:12345-192.168.203.60@tcp:58:dd.0 Request processed in 2876us (3675us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683563.430083:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 37 00000100:00100000:1.0:1789683563.437663:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.445029:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803012736 00000100:00100000:3.0:1789683563.445051:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803012736 00000100:00100000:3.0:1789683563.445229:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 38 00000100:00100000:3.0:1789683563.445243:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+23:14477:x1876618803012736:12345-192.168.203.60@tcp:101:dd.0 00010000:00010000:3.0:1789683563.445272:0:16284:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683563.445301:0:16284:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04f8 expref: -99 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.445376:0:16284:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.445388:0:16284:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff7d lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f8 expref: 24 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.445412:0:16284:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.445427:0:16284:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff7d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f8 expref: 24 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.445443:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:3.0:1789683563.445463:0:16284:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789683563.445469:0:16284:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff7d lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f8 expref: 24 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.445478:0:16284:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c97400, rc 0) 00000100:00100000:3.0:1789683563.445587:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+24:14477:x1876618803012736:12345-192.168.203.60@tcp:101:dd.0 Request processed in 347us (7938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683563.445595:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 38 00000040:00080000:0.0:1789683563.553999:0:14441:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789683563.554014:0:14441:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789683563.554064:0:14441:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789683563.554072:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789683563.554246:0:14441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c525180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14441:1876618815583360:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789683563.554447:0:14441:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe544a4240 going to sleep for 11 seconds 00000100:00100000:0.0:1789683563.560063:0:14441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c525180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14441:1876618815583360:192.168.203.60@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789683563.572209:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683563.581592:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803012864 00000100:00100000:2.0:1789683563.581615:0:14420:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803012864 00000100:00100000:2.0:1789683563.581707:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1789683563.581722:0:14420:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f78a790a-0341-4215-9612-09be69631436+24:14478:x1876618803012864:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789683563.582720:0:14420:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c525180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f78a790a-0341-4215-9612-09be69631436+24:14478:x1876618803012864:12345-192.168.203.60@tcp:900:lhsmtool_posix.0 Request processed in 993us (10516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683563.582900:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:1.0:1789683563.595720:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.595958:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803012992 00000100:00100000:3.0:1789683563.595973:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803012992 00000100:00100000:3.0:1789683563.596048:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:3.0:1789683563.596062:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+24:14478:x1876618803012992:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789683563.596136:0:14411:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789683563.596471:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+24:14478:x1876618803012992:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 411us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683563.596480:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 39 00000100:00100000:1.0:1789683563.613090:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.613273:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803013120 00000100:00100000:0.0:1789683563.613286:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803013120 00000100:00100000:0.0:1789683563.613352:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:0.0:1789683563.613363:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+24:14478:x1876618803013120:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789683563.613455:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613474:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613488:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613505:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613512:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613519:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613544:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613553:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613595:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789683563.613644:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789683563.613649:0:14409:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789683563.613665:0:14409:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613716:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613723:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613971:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613978:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f200 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683563.613983:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.613992:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614005:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe6097c800) 00010000:00010000:0.0:1789683563.614008:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683563.614014:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614021:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f200/0x59bee33f93fff84 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614048:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614055:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614061:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614065:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683563.614068:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614074:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614080:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683563.614082:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683563.614085:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614090:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fff8b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614105:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614110:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614116:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614125:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683563.614128:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614134:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614141:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:0.0:1789683563.614142:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683563.614145:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.614150:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fff92 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683563.614241:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+24:14478:x1876618803013120:12345-192.168.203.60@tcp:34:lhsmtool_posix.0 Request processed in 877us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.614250:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 40 00000100:00100000:0.0:1789683563.629554:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.630079:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803013376 00000100:00100000:3.0:1789683563.630094:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803013376 00000100:00100000:3.0:1789683563.630181:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:3.0:1789683563.630194:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+24:14478:x1876618803013376:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683563.630221:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683563.630248:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f93fff99 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f04ff expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.630374:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.630391:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.630422:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683563.630436:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789683563.630560:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.630569:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.630576:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.630582:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97a00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683563.630598:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.630606:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.630620:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:3.0:1789683563.630623:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789683563.630628:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.630634:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93fffa0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.631379:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f93fff99 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ff expref: 26 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.631408:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8dbe6097c800) 00010000:00010000:3.0:1789683563.631411:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789683563.631416:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f93fff99 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04ff expref: 26 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.631431:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c97000, rc 0) 00000100:00100000:3.0:1789683563.631632:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+25:14478:x1876618803013376:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1440us (2092us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1789683563.631642:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 41 00000100:00100000:1.0:1789683563.643254:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.643381:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803013504 00000100:00100000:0.0:1789683563.643396:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803013504 00000100:00100000:0.0:1789683563.643474:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:0.0:1789683563.643488:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+25:14478:x1876618803013504:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789683563.643539:0:14409:0:(mdt_handler.c:7980:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789683563.643750:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+25:14478:x1876618803013504:12345-192.168.203.60@tcp:53:lhsmtool_posix.0 Request processed in 264us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.643758:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 42 00000100:00100000:1.0:1789683563.653337:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683563.653619:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803013760 00000100:00100000:2.0:1789683563.653632:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803013760 00000100:00100000:2.0:1789683563.653744:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:2.0:1789683563.653757:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+25:14478:x1876618803013760:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683563.653787:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683563.653826:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fffae lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0506 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789683563.654643:0:14410:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1789683563.654652:0:14410:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1789683563.654749:0:14410:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1789683563.655080:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93fffb5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.655107:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93fffb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.655122:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93fffb5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.655198:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fffae lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0506 expref: 28 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.655220:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93fffb5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0506 expref: 27 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.655229:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c500) 00010000:00010000:2.0:1789683563.655232:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789683563.655238:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908600, rc 0) 00000100:00100000:2.0:1789683563.655332:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+27:14478:x1876618803013760:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1577us (2008us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1789683563.655341:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 43 00000100:00100000:1.0:1789683563.665987:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.666135:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803014016 00000100:00100000:0.0:1789683563.666170:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803014016 00000100:00100000:0.0:1789683563.666249:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:0.0:1789683563.666262:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+27:14478:x1876618803014016:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789683563.666341:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683563.666375:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93fffb5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0506 expref: 27 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666399:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c500) 00010000:00010000:0.0:1789683563.666412:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789683563.666440:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666456:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666467:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666482:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666490:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666496:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666577:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666586:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666601:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666607:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f800 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683563.666613:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666622:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666630:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8dbe6097c300) 00010000:00010000:0.0:1789683563.666632:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683563.666637:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666643:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffc3 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666653:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666659:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666666:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666721:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683563.666725:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666809:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666818:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x9f0e6f57 (ffff8dbe60aa2b00) 00010000:00010000:0.0:1789683563.666821:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789683563.666824:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.666830:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffca lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x9f0e6f57 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683563.667021:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+26:14478:x1876618803014016:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 760us (1046us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789683563.667029:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 44 00000100:00100000:1.0:1789683563.672137:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683563.672245:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803014144 00000100:00100000:2.0:1789683563.672259:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803014144 00000100:00100000:2.0:1789683563.672330:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:2.0:1789683563.672342:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+26:14478:x1876618803014144:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789683563.672371:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789683563.672403:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fffd1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f050d expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.672447:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93fffd8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.672478:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93fffd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.672493:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93fffd8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.673355:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908e00/0x59bee33f93fffd1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f050d expref: 28 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.673383:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b908600/0x59bee33f93fffd8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f050d expref: 27 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.673393:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c200) 00010000:00010000:2.0:1789683563.673396:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683563.673400:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7b908600, rc 0) 00000100:00100000:2.0:1789683563.673532:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+27:14478:x1876618803014144:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 1191us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683563.673541:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 45 00000100:00100000:3.0:1789683563.687377:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.688079:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803014400 00000100:00100000:0.0:1789683563.688095:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803014400 00000100:00100000:0.0:1789683563.688168:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 46 00000100:00100000:0.0:1789683563.688178:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+27:14478:x1876618803014400:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789683563.688291:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.688313:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.688326:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789683563.689210:0:14409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1789683563.689226:0:14409:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 497320552233ns, next at 498320548683ns, rc = 0 00000004:00010000:0.0:1789683563.689605:0:14409:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009fee743 reply state 00000000817965be transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683563.689618:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789683563.690145:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+29:14478:x1876618803014400:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 1962us (2775us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789683563.690155:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 46 00010000:00010000:0.0:1789683563.694091:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.694115:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.694125:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.694132:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:0.0:1789683563.694139:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.694147:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.694171:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c200) 00010000:00010000:0.0:1789683563.694175:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789683563.694182:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.694188:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f000/0x59bee33f93fffdf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683563.695199:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.698428:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803014528 00000100:00100000:0.0:1789683563.698472:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803014528 00000100:00100000:0.0:1789683563.698556:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:0.0:1789683563.698569:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+28:14478:x1876618803014528:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789683563.698602:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789683563.698631:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0514 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.698875:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0514 expref: 29 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.698895:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0514 expref: 29 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.698920:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c200) 00010000:00010000:0.0:1789683563.698924:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789683563.698928:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbe7c40f800, rc 0) 00000100:00100000:0.0:1789683563.699015:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+29:14478:x1876618803014528:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 448us (3824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.699022:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 47 00000100:00100000:1.0:1789683563.719620:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.719753:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803014656 00000100:00100000:0.0:1789683563.719766:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803014656 00000100:00100000:0.0:1789683563.719843:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:0.0:1789683563.719871:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+5:2353:x1876618803014656:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1789683563.720355:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+6:2353:x1876618803014656:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 492us (747us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789683563.720364:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 12 00000100:00100000:3.0:1789683563.723664:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683563.727402:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803014912 00000100:00100000:2.0:1789683563.727426:0:14412:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803014912 00000100:00100000:3.0:1789683563.727722:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:3.0:1789683563.727988:0:14412:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+29:14478:x1876618803014912:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789683563.728344:0:14412:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f78a790a-0341-4215-9612-09be69631436+30:14478:x1876618803014912:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 361us (4693us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1789683563.733129:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 9 00000100:00100000:1.0:1789683563.733273:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.733376:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803015168 00000100:00100000:3.0:1789683563.733388:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803015168 00000100:00100000:3.0:1789683563.733504:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:3.0:1789683563.733516:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+30:14478:x1876618803015168:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789683563.733720:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d6ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+30:14478:x1876618803015168:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 205us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683563.733737:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 48 00000100:00100000:0.0:1789683563.738219:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.738346:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803015296 00000100:00100000:3.0:1789683563.738362:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803015296 00000100:00100000:3.0:1789683563.738472:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:3.0:1789683563.738485:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+30:14478:x1876618803015296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683563.738513:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683563.738541:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f93fffed lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f051b expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.738642:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93ffff4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.738661:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93ffff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.738709:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93ffff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789683563.738769:0:14411:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789683563.738795:0:14411:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93ffff4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.738836:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f93fffed lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f051b expref: 32 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.739100:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93ffff4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f051b expref: 31 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.739111:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c200) 00010000:00010000:3.0:1789683563.739115:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789683563.739120:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c97a00, rc 0) 00000100:00100000:3.0:1789683563.739212:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+31:14478:x1876618803015296:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 730us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683563.739221:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 49 00000100:00100000:1.0:1789683563.743139:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.743231:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803015424 00000100:00100000:3.0:1789683563.743243:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803015424 00000100:00100000:3.0:1789683563.743306:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:3.0:1789683563.743318:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78a790a-0341-4215-9612-09be69631436+6:2352:x1876618803015424:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789683563.743341:0:15093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789683563.743367:0:15093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x4c6bbc39449f0522 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789683563.743400:0:15093:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aac676c, blocks: 0x1 00010000:00010000:3.0:1789683563.743423:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=497s v=(0 0) 00010000:00010000:3.0:1789683563.743429:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789683563.743440:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0522 expref: 7 pid: 15093 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.743461:0:15093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0522 expref: 7 pid: 15093 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.743476:0:15093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8dbd44c96800, rc 0) 00000100:00100000:3.0:1789683563.743597:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76137480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78a790a-0341-4215-9612-09be69631436+7:2352:x1876618803015424:12345-192.168.203.60@tcp:101:lhsmtool_posix.0 Request processed in 280us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683563.743605:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1789683563.747548:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683563.747668:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803015680 00000100:00100000:1.0:1789683563.747715:0:14409:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803015680 00000100:00100000:1.0:1789683563.747798:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:1.0:1789683563.747811:0:14409:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+31:14478:x1876618803015680:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789683563.747959:0:14409:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c173800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f78a790a-0341-4215-9612-09be69631436+31:14478:x1876618803015680:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 151us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683563.747968:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 50 00000100:00100000:0.0:1789683563.761374:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683563.762234:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803015808 00000100:00100000:1.0:1789683563.762250:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803015808 00000100:00100000:1.0:1789683563.762394:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:1.0:1789683563.762408:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+31:14478:x1876618803015808:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789683563.858113:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1789683563.858128:0:5851:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789683563.858163:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:3.0:1789683563.858222:0:5851:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:1.0:1789683563.858512:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789683563.858540:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815583488:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789683563.858624:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789683563.858841:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815583488 00000100:00100000:0.0:1789683563.858859:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815583488 00000100:00100000:0.0:1789683563.858929:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789683563.858940:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815583488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789683563.859101:0:15095:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789683563.859105:0:15095:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789683563.859108:0:15095:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789683563.859109:0:15095:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789683564 -> 1789683564 00002000:00010000:0.0:1789683563.859112:0:15095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789683563.859158:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b91a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3303:x1876618815583488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (534us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789683563.859165:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1789683563.859215:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8dbe76137b80/2, rc 0, transno 8589934595 00000100:00100000:0.0:1789683563.859221:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76137b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815583488:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1789683563.859340:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683563.860995:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f78a790a-0341-4215-9612-09be69631436+14:14478:x1876618803015808:12345-192.168.203.60@tcp:44:lhsmtool_posix.0 Request processed in 98582us (99627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683563.861007:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 51 00000100:00100000:2.0:1789683563.866385:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.869235:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803015936 00000100:00100000:3.0:1789683563.869254:0:15093:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803015936 00000100:00100000:3.0:1789683563.869378:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:3.0:1789683563.869389:0:15093:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78a790a-0341-4215-9612-09be69631436+7:2353:x1876618803015936:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789683563.869546:0:15093:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f78a790a-0341-4215-9612-09be69631436+7:2353:x1876618803015936:12345-192.168.203.60@tcp:16:lhsmtool_posix.0 Request processed in 158us (3169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683563.869554:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 15 00000100:00100000:0.0:1789683563.880601:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.880754:0:16284:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803016192 00000100:00100000:3.0:1789683563.880765:0:16284:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803016192 00000100:00100000:3.0:1789683563.880820:0:16284:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:3.0:1789683563.880829:0:16284:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+14:14478:x1876618803016192:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789683563.880885:0:16284:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789683563.880911:0:16284:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97a00/0x59bee33f93ffff4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f051b expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.880929:0:16284:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c200) 00010000:00010000:3.0:1789683563.880934:0:16284:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789683563.880960:0:16284:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.880972:0:16284:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.880980:0:16284:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789683563.881192:0:16284:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000079cfd03d reply state 00000000ee945f99 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683563.881215:0:16284:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789683563.881311:0:16284:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f78a790a-0341-4215-9612-09be69631436+15:14478:x1876618803016192:12345-192.168.203.60@tcp:36:lhsmtool_posix.0 Request processed in 482us (718us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789683563.881318:0:16284:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 52 00000100:00100000:0.0:1789683563.884375:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683563.884779:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803016320 00000100:00100000:1.0:1789683563.884789:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803016320 00000100:00100000:1.0:1789683563.884860:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 16 00000100:00100000:1.0:1789683563.884870:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+7:2352:x1876618803016320:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789683563.885073:0:15095:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1789683563.885077:0:15095:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789683563 00002000:00010000:1.0:1789683563.885080:0:15095:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789683563 00002000:00010000:1.0:1789683563.885082:0:15095:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789683564 -> 1789683563 00002000:00010000:1.0:1789683563.885084:0:15095:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789683563.885142:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c170380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f78a790a-0341-4215-9612-09be69631436+8:2352:x1876618803016320:12345-192.168.203.60@tcp:2:lhsmtool_posix.0 Request processed in 272us (772us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789683563.885149:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 16 00010000:00010000:3.0:1789683563.887071:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.887090:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.887099:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.887105:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:3.0:1789683563.887111:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.887119:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.887137:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c200) 00010000:00010000:3.0:1789683563.887140:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789683563.887146:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.887152:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97000/0x59bee33f9400002 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16284 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683563.887359:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683563.887450:0:16283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803016448 00000100:00100000:1.0:1789683563.887460:0:16283:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803016448 00000100:00100000:1.0:1789683563.887523:0:16283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:1.0:1789683563.887533:0:16283:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f78a790a-0341-4215-9612-09be69631436+8:2353:x1876618803016448:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789683563.887586:0:16283:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.887602:0:16283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683563.887606:0:16283:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683563.887612:0:16283:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.887646:0:16283:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.887703:0:16283:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.887712:0:16283:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.887719:0:16283:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.887724:0:16283:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:1.0:1789683563.887727:0:16283:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.887735:0:16283:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.887746:0:16283:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.887753:0:16283:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400009 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683563.888343:0:16283:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c171500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:f78a790a-0341-4215-9612-09be69631436+8:2353:x1876618803016448:12345-192.168.203.60@tcp:1:lhsmtool_posix.0 Request processed in 808us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683563.888351:0:16283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 17 00000100:00100000:0.0:1789683563.891031:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683563.891119:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803016704 00000100:00100000:3.0:1789683563.891129:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803016704 00000100:00100000:3.0:1789683563.891240:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 53 00000100:00100000:3.0:1789683563.891251:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+14:14478:x1876618803016704:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789683563.891342:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.891359:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.891370:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.891605:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.891618:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0514 expref: 15 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.891627:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.891663:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0514 expref: 15 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.891715:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0514 expref: 15 pid: 14411 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683563.891730:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f36300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14411:1876618815583616:192.168.203.60@tcp:104: 00000100:00100000:3.0:1789683563.892199:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9000 going to sleep for 11 seconds 00000100:00100000:1.0:1789683563.894780:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.894923:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803016832 00000100:00100000:0.0:1789683563.894932:0:14394:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803016832 00010000:00010000:0.0:1789683563.894972:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0514 expref: 16 pid: 14411 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683563.895010:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 13 00000100:00100000:0.0:1789683563.895020:0:14394:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78a790a-0341-4215-9612-09be69631436+16:2352:x1876618803016832:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789683563.895048:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789683563.895056:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0514 expref: 16 pid: 14411 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.895068:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0514 expref: 16 pid: 14411 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.895090:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c200) 00010000:00010000:0.0:1789683563.895096:0:14394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.895106:0:14394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.895114:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.895134:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789683563.895184:0:14394:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f78a790a-0341-4215-9612-09be69631436+16:2352:x1876618803016832:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 166us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.895192:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 13 00010000:00010000:3.0:1789683563.895766:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40f800/0x59bee33f93fffe6 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0514 expref: 15 pid: 14411 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683563.895798:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f36300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14411:1876618815583616:192.168.203.60@tcp:104: 00010000:00010000:3.0:1789683563.895945:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.895955:0:14411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.895961:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683563.896148:0:14411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1789683563.896280:0:14411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1789683563.896323:0:14411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1789683563.896432:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f36300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14411:1876618815583744:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789683563.896484:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683563.896509:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe708c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789683563.896605:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815583744 00000100:00100000:0.0:1789683563.896612:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815583744 00000100:00100000:0.0:1789683563.896656:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789683563.896665:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14411:x1876618815583744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789683563.896773:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14411:x1876618815583744:12345-0@lo:1000:mdt00_002.0 Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.896781:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789683563.896936:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f36300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14411:1876618815583744:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789683563.898415:0:14411:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1789683563.898500:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14411:1876618815583872:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789683563.898576:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789683563.898610:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe497d5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789683563.898744:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815583872 00000100:00100000:0.0:1789683563.898752:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815583872 00000100:00100000:0.0:1789683563.898790:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789683563.898797:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14411:x1876618815583872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789683563.899120:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14411:x1876618815583872:12345-0@lo:1000:mdt00_002.0 Request processed in 322us (555us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1789683563.899127:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789683563.899266:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a32300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14411:1876618815583872:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789683563.899302:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899313:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899320:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899326:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c96c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683563.899330:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899338:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899354:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c200) 00010000:00010000:1.0:1789683563.899365:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683563.899371:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899378:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c96c00/0x59bee33f9400017 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899411:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899417:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899424:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899429:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc7000 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:1.0:1789683563.899432:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899438:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899446:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:1.0:1789683563.899449:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789683563.899456:0:14411:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff7d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f8 expref: 18 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899468:0:14411:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff7d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f8 expref: 18 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899477:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f8 expref: 18 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683563.899536:0:14411:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97400/0x59bee33f93fff7d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f04f8 expref: 18 pid: 16284 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683563.899549:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76a30000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14411:1876618815584000:192.168.203.60@tcp:105: 00000100:00100000:1.0:1789683563.899732:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe497d5300 going to sleep for 11 seconds 00000100:00100000:1.0:1789683563.903518:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683563.903598:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803016960 00000100:00100000:0.0:1789683563.903607:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803016960 00000100:00100000:0.0:1789683563.903661:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:0.0:1789683563.903689:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7bdd1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78a790a-0341-4215-9612-09be69631436+19:14477:x1876618803016960:12345-192.168.203.60@tcp:49:dd.0 00000100:00100000:0.0:1789683563.903823:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7bdd1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78a790a-0341-4215-9612-09be69631436+19:14477:x1876618803016960:12345-192.168.203.60@tcp:49:dd.0 Request processed in 153us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1789683563.903831:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 10 00000100:00100000:3.0:1789683563.906983:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76a30000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14411:1876618815584000:192.168.203.60@tcp:105: 00010000:00010000:3.0:1789683563.907015:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683563.907027:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe76fc7000/0x59bee33f93fff76 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.910800:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.910951:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.910978:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.910993:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.910999:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911006:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911011:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683563.911016:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911023:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911033:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:2.0:1789683563.911036:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789683563.911042:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911048:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7b909c00/0x59bee33f940001e lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911064:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911070:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911082:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911087:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbd44c97c00 already unused, calling callback (ffffffffc1fc54f0) 00010000:00010000:2.0:1789683563.911090:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911096:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911104:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8dbe6097cf00) 00010000:00010000:2.0:1789683563.911106:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789683563.911109:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.911114:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbd44c97c00/0x59bee33f9400010 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683563.915218:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c172d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f78a790a-0341-4215-9612-09be69631436+18:14478:x1876618803016704:12345-192.168.203.60@tcp:57:lhsmtool_posix.0 Request processed in 23956us (24182us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789683563.915232:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 53 00000020:00080000:0.0:1789683563.915239:0:14411:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1789683563.923129:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000040:00080000:2.0:1789683563.923608:0:14441:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789683563.923614:0:14441:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789683563.923643:0:14441:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789683563.923647:0:14441:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789683563.924921:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803017216 00000100:00100000:0.0:1789683563.924934:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803017216 00000100:00100000:0.0:1789683563.925031:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 11 00000100:00100000:0.0:1789683563.925042:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78a790a-0341-4215-9612-09be69631436+18:14478:x1876618803017216:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789683563.925962:0:14413:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789683563.926062:0:14413:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:0.0:1789683563.926112:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.926142:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.926155:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.926165:0:14413:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.926171:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.926178:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683563.926195:0:14413:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789683563.926409:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76a32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f78a790a-0341-4215-9612-09be69631436+20:14478:x1876618803017216:12345-192.168.203.60@tcp:35:lhsmtool_posix.0 Request processed in 1365us (3283us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1789683563.926418:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 11 00000020:00080000:0.0:1789683563.926423:0:14413:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789683563.926495:0:14398:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789683563.926502:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.926509:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40ec00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683563.926514:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.926532:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.926546:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8dbe6097c200) 00010000:00010000:2.0:1789683563.926549:0:14398:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789683563.926554:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.926561:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8dbe7c40ec00/0x59bee33f9400025 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683563.926583:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683563.926585:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683563.926586:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789683564.034590:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683564.034638:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683564.034877:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803017344 00000100:00100000:0.0:1789683564.034888:0:15098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803017344 00000100:00100000:0.0:1789683564.034955:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803017472 00000100:00100000:0.0:1789683564.034958:0:15098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803017472 00000100:00100000:0.0:1789683564.034979:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:0.0:1789683564.034989:0:15098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f78a790a-0341-4215-9612-09be69631436+9:2355:x1876618803017344:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:0.0:1789683564.035024:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.035045:0:15098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0522 expref: 9 pid: 15093 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.035068:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683564.035072:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683564.035077:0:15098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.035110:0:15098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0522 expref: 9 pid: 15093 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.035125:0:15098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0522 expref: 9 pid: 15093 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683564.035150:0:15098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7c172300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15098:1876618815584128:192.168.203.60@tcp:104: 00000100:00100000:0.0:1789683564.035233:0:15098:0:(client.c:2716:ptlrpc_set_wait()) set ffff8dbe544a4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789683564.040899:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683564.040990:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803017600 00000100:00100000:1.0:1789683564.040999:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803017600 00010000:00010000:1.0:1789683564.041040:0:14396:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0522 expref: 10 pid: 15093 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789683564.041089:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 14 00000100:00100000:1.0:1789683564.041100:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f78a790a-0341-4215-9612-09be69631436+10:2353:x1876618803017600:12345-192.168.203.60@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789683564.041116:0:14396:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789683564.041139:0:14396:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0522 expref: 10 pid: 15093 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683564.041153:0:14396:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0522 expref: 10 pid: 15093 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683564.041178:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683564.041182:0:14396:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683564.041187:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683564.041217:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683564.041240:0:14396:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789683564.041294:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f78a790a-0341-4215-9612-09be69631436+10:2353:x1876618803017600:12345-192.168.203.60@tcp:103:ldlm_bl.0 Request processed in 195us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789683564.041302:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 14 00010000:00010000:0.0:1789683564.042740:0:15098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bfd6a32/0x59bee33f93ffffb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.60@tcp remote: 0x4c6bbc39449f0522 expref: 9 pid: 15093 timeout: 597 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683564.042763:0:15098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7c172300 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15098:1876618815584128:192.168.203.60@tcp:104: 00010000:00010000:0.0:1789683564.042791:0:15098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.042802:0:15098:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.042820:0:15098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683564.046963:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683564.047744:0:15099:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1789683564.047755:0:15099:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789683564.048086:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803017728 00000100:00100000:0.0:1789683564.048095:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803017728 00000100:00100000:1.0:1789683564.048619:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 1 00000100:00100000:1.0:1789683564.048632:0:16638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f78a790a-0341-4215-9612-09be69631436+10:2355:x1876618803017472:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:1.0:1789683564.048705:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683564.048726:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683564.048730:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683564.048736:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683564.048751:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683564.127831:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789683564.156455:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1789683564.156480:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:2.0:1789683564.161201:0:15098:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:2.0:1789683564.161210:0:15098:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789683563 -> 1789683564 00002000:00010000:2.0:1789683564.161213:0:15098:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1789683564.161227:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.161240:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.161249:0:15098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.161277:0:15098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683564.161282:0:15098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.161291:0:15098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.161311:0:15098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.161318:0:15098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f940002c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683564.161421:0:15098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f78a790a-0341-4215-9612-09be69631436+10:2355:x1876618803017344:12345-192.168.203.60@tcp:4:dd.0 Request processed in 126428us (126835us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1789683564.161435:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 0 00000100:00100000:2.0:1789683564.161469:0:15098:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:2.0:1789683564.161482:0:15098:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe799c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f78a790a-0341-4215-9612-09be69631436+9:2354:x1876618803017728:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:2.0:1789683564.161527:0:15098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.161539:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683564.161544:0:15098:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683564.161550:0:15098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.161582:0:15098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789683564.213021:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00002000:00010000:0.0:1789683564.213240:0:16638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00010000:00010000:0.0:1789683564.213256:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.213270:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.213279:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.213287:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683564.213292:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.213302:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.213322:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.213330:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400033 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683564.213421:0:16638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f78a790a-0341-4215-9612-09be69631436+9:2355:x1876618803017472:12345-192.168.203.60@tcp:4:dd.0 Request processed in 164787us (178777us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1789683564.213448:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 1 00000001:00080000:3.0:1789683564.280386:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789683564.280553:0:15098:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1789683564.280568:0:15098:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.280581:0:15098:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.280590:0:15098:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.280597:0:15098:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683564.280603:0:15098:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.280612:0:15098:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.280644:0:15098:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.280653:0:15098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940003a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683564.280782:0:15098:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe799c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f78a790a-0341-4215-9612-09be69631436+5:2354:x1876618803017728:12345-192.168.203.60@tcp:4:dd.0 Request processed in 119300us (233826us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789683564.280792:0:15098:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 2 00000100:00100000:0.0:1789683564.290046:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:1.0:1789683564.290167:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803017856 00000100:00100000:1.0:1789683564.290178:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803017856 00000100:00100000:1.0:1789683564.290269:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:1.0:1789683564.290280:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7c172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f78a790a-0341-4215-9612-09be69631436+5:2354:x1876618803017856:12345-192.168.203.60@tcp:4:dd.0 00002000:00010000:1.0:1789683564.290342:0:15099:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6aac676c, atime: 0x6aac676b, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1789683564.290351:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683564.290368:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=497s v=(0 0) 00010000:00010000:1.0:1789683564.290373:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789683564.290380:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789683564.290395:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683564.292743:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:0.0:1789683564.292939:0:16638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803017984 00000100:00100000:0.0:1789683564.292949:0:16638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803017984 00000100:00100000:0.0:1789683564.293020:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 4 00000100:00100000:0.0:1789683564.293031:0:16638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f78a790a-0341-4215-9612-09be69631436+7:2354:x1876618803017984:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:0.0:1789683564.293068:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.293084:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683564.293089:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683564.293095:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.293109:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683564.301816:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683564.302076:0:15100:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789683564.302087:0:15100:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789683564.302408:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803018112 00000100:00100000:2.0:1789683564.302419:0:15100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803018112 00000100:00100000:0.0:1789683564.303470:0:16640:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 5 00000100:00100000:0.0:1789683564.303487:0:16640:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f78a790a-0341-4215-9612-09be69631436+9:2354:x1876618803018112:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:0.0:1789683564.303526:0:16640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.303544:0:16640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683564.303548:0:16640:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789683564.303555:0:16640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.303582:0:16640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683564.306605:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:3.0:1789683564.306660:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.60@tcp (source: 12345-192.168.203.60@tcp) 00000100:00100000:2.0:1789683564.306817:0:15100:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789683564.306829:0:15100:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1789683564.307059:0:15098:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1789683564.307071:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803018368 00000100:00100000:1.0:1789683564.307080:0:15098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803018368 00000100:00100000:1.0:1789683564.307141:0:15098:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1789683564.307147:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618803018240 00000100:00100000:1.0:1789683564.307150:0:15098:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618803018240 00000100:00100000:2.0:1789683564.308320:0:16641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 6 00000100:00100000:2.0:1789683564.308335:0:16641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f78a790a-0341-4215-9612-09be69631436+11:2354:x1876618803018368:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:2.0:1789683564.308376:0:16641:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.308394:0:16641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683564.308399:0:16641:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683564.308405:0:16641:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.308422:0:16641:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789683564.409267:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:2.0:1789683564.409736:0:15099:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7654321 00002000:00010000:2.0:1789683564.409741:0:15099:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1789683564 00002000:00010000:2.0:1789683564.409744:0:15099:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1789683564.409758:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.409783:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.409792:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.409799:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe76fc6600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683564.409817:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.409828:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.409860:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.409868:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e94fc575/0x59bee33f9400041 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683564.409959:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7c172300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f78a790a-0341-4215-9612-09be69631436+18:2354:x1876618803017856:12345-192.168.203.60@tcp:4:dd.0 Request processed in 119676us (119921us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789683564.409968:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 3 00000100:00100000:2.0:1789683564.409995:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.60@tcp, seq: 7 00000100:00100000:2.0:1789683564.410006:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f78a790a-0341-4215-9612-09be69631436+17:2354:x1876618803018240:12345-192.168.203.60@tcp:4:dd.0 00010000:00010000:2.0:1789683564.410037:0:15099:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.410054:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1789683564.410058:0:15099:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789683564.410064:0:15099:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.410076:0:15099:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789683564.464223:0:16641:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 14343 00010000:00010000:0.0:1789683564.464247:0:16641:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.464261:0:16641:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.464271:0:16641:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.464278:0:16641:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909a00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683564.464282:0:16641:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.464291:0:16641:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.464311:0:16641:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.464318:0:16641:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcc8b18b/0x59bee33f9400056 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16641 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683564.464437:0:16641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f78a790a-0341-4215-9612-09be69631436+19:2354:x1876618803018368:12345-192.168.203.60@tcp:4:dd.0 Request processed in 156102us (157837us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1789683564.464447:0:16641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 6 00000001:00080000:0.0:1789683564.464489:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:0.0:1789683564.464509:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:3.0:1789683564.469187:0:16640:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789683564.469213:0:16640:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683564.469226:0:16640:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683564.469236:0:16640:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683564.469243:0:16640:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40fa00 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:3.0:1789683564.469248:0:16640:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683564.469258:0:16640:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683564.469280:0:16640:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789683564.469287:0:16640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af2558ee/0x59bee33f940004f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789683564.469391:0:16640:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f78a790a-0341-4215-9612-09be69631436+11:2354:x1876618803018112:12345-192.168.203.60@tcp:4:dd.0 Request processed in 165904us (167591us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789683564.469417:0:16640:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 5 00010000:00010000:2.0:1789683564.477534:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.477554:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.477665:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.478723:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7c40f600 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:2.0:1789683564.478729:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.478741:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.478763:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789683564.478783:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fae7411/0x59bee33f9400048 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789683564.480226:0:16638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f78a790a-0341-4215-9612-09be69631436+9:2354:x1876618803017984:12345-192.168.203.60@tcp:4:dd.0 Request processed in 187186us (187482us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789683564.480240:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 4 00000001:00080000:1.0:1789683564.505083:0:7641:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1789683564.505173:0:15099:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.505188:0:15099:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.505196:0:15099:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.505204:0:15099:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8dbe7b909200 already unused, calling callback (ffffffffc15648b0) 00010000:00010000:0.0:1789683564.505209:0:15099:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.505219:0:15099:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.505238:0:15099:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789683564.505246:0:15099:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009a086408/0x59bee33f940005d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15099 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789683564.505388:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f78a790a-0341-4215-9612-09be69631436+5:2354:x1876618803018240:12345-192.168.203.60@tcp:4:dd.0 Request processed in 95379us (198721us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789683564.505398:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.60@tcp, seq: 7 00010000:00010000:2.0:1789683565.151968:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789683566.037274:0:16679:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1789683566.048885:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815584256:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.048962:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683566.049003:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815584768:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049024:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683566.049045:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683566.049050:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815584640:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049065:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683566.049086:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815584512:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049106:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683566.049121:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789683566.049125:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe799c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815584384:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049142:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683566.049155:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815584896:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049169:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683566.049191:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815584256 00000100:00100000:2.0:1789683566.049197:0:14404:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815584256 00000100:00100000:2.0:1789683566.049232:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789683566.049251:0:14404:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7d69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:3303:x1876618815584256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049293:0:14404:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7d69dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:267f495e-c971-4db4-b237-3907c961127d+19:3303:x1876618815584256:12345-0@lo:400:kworker.0 Request processed in 42us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683566.049300:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789683566.049327:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815584512 00000100:00100000:2.0:1789683566.049330:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815584512 00000100:00100000:2.0:1789683566.049366:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815584384 00000100:00100000:2.0:1789683566.049368:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815584384 00000100:00100000:2.0:1789683566.049387:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683566.049392:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815584512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049425:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815584512:12345-0@lo:400:kworker.0 Request processed in 33us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683566.049431:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683566.049441:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683566.049446:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815584384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049467:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b948380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815584384:12345-0@lo:400:kworker.0 Request processed in 21us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683566.049472:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789683566.049488:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815584768 00000100:00100000:2.0:1789683566.049491:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815584768 00000100:00100000:2.0:1789683566.049511:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815584640 00000100:00100000:2.0:1789683566.049514:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815584640 00000100:00100000:2.0:1789683566.049523:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815584896 00000100:00100000:2.0:1789683566.049525:0:14410:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815584896 00000100:00100000:2.0:1789683566.049537:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683566.049542:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815584768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049569:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876618815584768:12345-0@lo:400:kworker.0 Request processed in 27us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683566.049582:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789683566.049596:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683566.049601:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815584640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049643:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876618815584640:12345-0@lo:400:kworker.0 Request processed in 42us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683566.049649:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789683566.049661:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789683566.049667:0:14410:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815584896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049713:0:14410:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b949180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876618815584896:12345-0@lo:400:kworker.0 Request processed in 47us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683566.049718:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1789683566.049734:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789683566.049739:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789683566.049741:0:14405:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789683566.049772:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815584384:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049781:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876618815584896:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.049787:0:3305:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1789683566.049791:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8dbe76137b80, transno 8589934595 00000004:00080000:2.0:1789683566.049802:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1789683566.049818:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815584512:0@lo:400:kworker.0 00000100:00100000:3.0:1789683566.050034:0:3305:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe76f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815585024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789683566.050072:0:3305:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789683566.050110:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815585024 00000100:00100000:3.0:1789683566.050115:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815585024 00000100:00100000:3.0:1789683566.050148:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683566.050155:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe76f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815585024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789683566.050184:0:15096:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789683566.050225:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe76f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876618815585024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789683566.050232:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789683566.050270:0:3305:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe76f37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876618815585024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789683566.050341:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b94ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876618815584640:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.050350:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe799c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:267f495e-c971-4db4-b237-3907c961127d:3303:1876618815584256:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.050359:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876618815584768:0@lo:400:kworker.0 00000100:00100000:2.0:1789683566.057988:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789683566.058010:0:3303:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8dbe7b948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815585152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789683566.058081:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789683566.058132:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876618815585152 00000100:00100000:2.0:1789683566.058139:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876618815585152 00000100:00100000:2.0:1789683566.058183:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683566.058192:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8dbe7b94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815585152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789683566.058226:0:15097:0:(ofd_obd.c:743:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:2.0:1789683566.058272:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8dbe7b94ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876618815585152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1789683566.058279:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789683566.058324:0:3303:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8dbe7b948a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876618815585152:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789683566.175804:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789683567.199899:0:14398:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29838 lines, 29838 kept, 0 dropped, 0 bad.